-- Logs begin at Thu 2022-06-23 10:50:16 UTC, end at Thu 2022-06-23 12:05:06 UTC. -- Jun 23 11:35:23.773391 dv-cinder-820994-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 23 11:35:23.782259 dv-cinder-820994-2-iscsi devstack@n-api.service[110135]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 23 11:35:23.784508 dv-cinder-820994-2-iscsi devstack@n-api.service[110135]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 23 11:35:23 2022] *** Jun 23 11:35:23.784508 dv-cinder-820994-2-iscsi devstack@n-api.service[110135]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 23 11:35:23.784508 dv-cinder-820994-2-iscsi devstack@n-api.service[110135]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 23 11:35:23.784508 dv-cinder-820994-2-iscsi devstack@n-api.service[110135]: nodename: dv-cinder-820994-2-iscsi Jun 23 11:35:23.784508 dv-cinder-820994-2-iscsi devstack@n-api.service[110135]: machine: x86_64 Jun 23 11:35:23.784508 dv-cinder-820994-2-iscsi devstack@n-api.service[110135]: clock source: unix Jun 23 11:35:23.784508 dv-cinder-820994-2-iscsi devstack@n-api.service[110135]: pcre jit disabled Jun 23 11:35:23.784508 dv-cinder-820994-2-iscsi devstack@n-api.service[110135]: detected number of CPU cores: 4 Jun 23 11:35:23.784508 dv-cinder-820994-2-iscsi devstack@n-api.service[110135]: current working directory: / Jun 23 11:35:23.784508 dv-cinder-820994-2-iscsi devstack@n-api.service[110135]: detected binary path: /usr/bin/uwsgi-core Jun 23 11:35:23.784508 dv-cinder-820994-2-iscsi devstack@n-api.service[110135]: your processes number limit is 47680 Jun 23 11:35:23.785309 dv-cinder-820994-2-iscsi devstack@n-api.service[110135]: your memory page size is 4096 bytes Jun 23 11:35:23.785309 dv-cinder-820994-2-iscsi devstack@n-api.service[110135]: detected max file descriptor number: 2048 Jun 23 11:35:23.785309 dv-cinder-820994-2-iscsi devstack@n-api.service[110135]: lock engine: pthread robust mutexes Jun 23 11:35:23.785309 dv-cinder-820994-2-iscsi devstack@n-api.service[110135]: thunder lock: enabled Jun 23 11:35:23.785309 dv-cinder-820994-2-iscsi devstack@n-api.service[110135]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 23 11:35:23.785309 dv-cinder-820994-2-iscsi devstack@n-api.service[110135]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 23 11:35:23.829191 dv-cinder-820994-2-iscsi devstack@n-api.service[110135]: Python main interpreter initialized at 0x55c7cdcf79c0 Jun 23 11:35:23.829191 dv-cinder-820994-2-iscsi devstack@n-api.service[110135]: python threads support enabled Jun 23 11:35:23.829191 dv-cinder-820994-2-iscsi devstack@n-api.service[110135]: your server socket listen backlog is limited to 100 connections Jun 23 11:35:23.829191 dv-cinder-820994-2-iscsi devstack@n-api.service[110135]: your mercy for graceful operations on workers is 90 seconds Jun 23 11:35:23.829796 dv-cinder-820994-2-iscsi devstack@n-api.service[110135]: mapped 403077 bytes (393 KB) for 2 cores Jun 23 11:35:23.829870 dv-cinder-820994-2-iscsi devstack@n-api.service[110135]: *** Operational MODE: preforking *** Jun 23 11:35:23.830118 dv-cinder-820994-2-iscsi devstack@n-api.service[110135]: *** uWSGI is running in multiple interpreter mode *** Jun 23 11:35:23.830118 dv-cinder-820994-2-iscsi devstack@n-api.service[110135]: spawned uWSGI master process (pid: 110135) Jun 23 11:35:23.830319 dv-cinder-820994-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 23 11:35:23.831744 dv-cinder-820994-2-iscsi devstack@n-api.service[110135]: spawned uWSGI worker 1 (pid: 110136, cores: 1) Jun 23 11:35:23.831744 dv-cinder-820994-2-iscsi devstack@n-api.service[110135]: spawned uWSGI worker 2 (pid: 110137, cores: 1) Jun 23 11:35:23.831945 dv-cinder-820994-2-iscsi devstack@n-api.service[110135]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 23 11:35:24.509887 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 23 11:35:24.523489 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 23 11:35:25.646434 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 11:35:25.646434 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: from cryptography.utils import int_from_bytes Jun 23 11:35:25.647064 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 11:35:25.647064 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: from cryptography.utils import int_from_bytes Jun 23 11:35:25.651152 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 11:35:25.651152 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: from cryptography.utils import int_from_bytes Jun 23 11:35:25.651601 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 11:35:25.651601 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: from cryptography.utils import int_from_bytes Jun 23 11:35:28.160280 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 23 11:35:28.161003 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 23 11:35:28.161362 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 23 11:35:28.161461 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 23 11:35:28.161547 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 23 11:35:28.161547 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 23 11:35:28.161690 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 23 11:35:28.161793 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 23 11:35:28.161871 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 23 11:35:28.162042 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 23 11:35:28.162179 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.162373 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.162474 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.162717 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.162836 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.163045 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.163139 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.163379 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.163482 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.163721 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.163821 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.164039 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.164133 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.164357 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.164459 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.164676 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.164769 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.164941 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.165034 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.165260 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.165347 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.165575 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.165672 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-820994-2-iscsi {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.165903 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.165989 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-820994-2-iscsi {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.166213 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.166300 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.166521 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.166627 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.166862 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.166963 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.167180 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.167266 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.167494 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.167580 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.167800 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.167898 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.168117 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.168299 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.169581 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.169694 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.169798 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.169871 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.169943 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.170014 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.170079 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.170148 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.170221 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.170291 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.170361 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.170426 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.170489 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.170588 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.170802 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.170916 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.171094 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.171238 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.171422 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.171667 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.171844 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.171988 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-820994-2-iscsi {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.172212 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-820994-2-iscsi {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.172353 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.172521 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.172699 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.172876 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.173094 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.173290 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.173484 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.173689 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.173885 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.174035 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.174249 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.174432 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.174648 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.174837 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.175015 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.175156 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.175343 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.175496 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.175633 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.175797 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.175921 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.176071 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.176198 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.176329 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.176453 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.176584 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.176714 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.176933 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.177066 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.177195 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.177326 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.177458 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.177581 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.177709 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.177833 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.177954 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.178081 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.178237 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.178368 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.178499 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.178653 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.178777 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.178914 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.179037 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.179159 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.179281 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.179487 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.179627 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.179761 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.179893 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.180024 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.180155 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.180284 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.180419 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.180592 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.180720 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.180903 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.181030 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.181406 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.181658 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.181793 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.181917 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.182046 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.182169 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.182304 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.182434 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.182592 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.182719 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.182855 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.182978 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.183109 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.183239 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.183361 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.183482 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.183604 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.183726 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.183919 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.184033 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.184260 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.184393 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.184582 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.184710 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.185032 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.185162 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.185283 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.185410 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.185587 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.185722 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.185931 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.186058 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.186254 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.186388 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.186585 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.186728 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.186984 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.187122 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.187245 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.187374 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.187530 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.187665 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.187841 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.187968 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.188150 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.188281 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.188469 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.188600 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.188803 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.188927 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.189107 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.189230 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.189520 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.189649 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.189780 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.189910 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.190034 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.190155 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.190893 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.191042 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.191173 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.191397 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.191570 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.191780 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.191928 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.192064 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.192197 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.192320 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.192449 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.192579 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.192710 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.192833 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.192960 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.193090 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.193213 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.193342 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.193472 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.193595 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.193741 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.193875 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.194056 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.194210 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.194366 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.194492 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.194716 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.194854 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.195043 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.195179 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.195370 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.195501 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.195676 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.195804 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.195985 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.196117 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.196296 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.196422 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.196607 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.196738 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.196928 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.197072 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.197271 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.197400 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.197529 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.197651 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.197839 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.197979 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.198149 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.198306 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.198459 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.198655 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.198810 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.198983 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.199124 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.199299 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.199428 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.199613 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.199740 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.199937 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.200075 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.200242 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.200368 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.200555 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.200688 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.200879 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.201013 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.201192 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.201317 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.201501 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.201638 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.201843 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.201984 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.202107 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.202235 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.202397 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.202597 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.202726 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.202898 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.203028 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.203151 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.203319 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.203465 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.203624 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.203750 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.203946 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.204072 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.204293 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.204682 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.204859 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.204985 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.205164 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.205273 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.205488 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.205617 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.205845 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.207002 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:35:28.207629 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.207757 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.207932 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.208196 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.208334 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.208458 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.208591 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.208716 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.208850 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.208973 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.209096 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.209228 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.209360 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.209492 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.209615 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.209737 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.209859 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.209995 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.210118 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.210318 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.210443 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.210598 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.210723 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.210845 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.210977 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.211109 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.211232 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.211361 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.211487 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.211647 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.211753 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.211865 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.212074 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.212184 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.212288 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.212402 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.212508 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.212625 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.212829 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.212956 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.213162 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.213287 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.213486 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.213619 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.213802 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.213923 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.214113 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.214233 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.214459 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.214629 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.214812 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.214939 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.215141 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.215276 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.215468 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.215580 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.215781 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.215900 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.216096 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.216226 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.216410 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.216536 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.216734 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.216859 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.217070 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.217195 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.217385 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.217511 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.217714 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.217857 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.218020 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.218155 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.218334 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.218460 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.218673 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.218800 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.218994 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.219130 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.219310 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.219438 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.219623 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.219749 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.219956 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.220090 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.220272 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.220399 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.220616 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.220752 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.220937 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.221074 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.221261 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.221388 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.221669 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.221949 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.222076 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.222563 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.222687 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.222912 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.223040 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.223162 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.223293 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.223416 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.223540 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.223668 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.223791 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.223913 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.224048 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.224172 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.224294 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.224415 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.224544 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.224667 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.224803 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.224927 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.225056 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.225394 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.225524 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.225648 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.225781 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.225904 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.226034 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.226165 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.226289 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.226420 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.226592 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.226723 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.226919 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.227045 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.227280 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.227611 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.227934 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.228243 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.228426 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.228614 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.228786 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.229114 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.229248 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.229430 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.229764 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.230095 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.230232 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.230449 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.230636 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.230800 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.230963 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.231151 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.231322 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.231486 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.231892 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.232021 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.232210 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.232335 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.232576 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.232715 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.232927 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.233054 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.233279 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.233406 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.233613 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.233740 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.233947 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.234080 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.234268 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.234393 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.234620 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.234747 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.234909 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.235034 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.235282 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.235422 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.235642 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.235828 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.235978 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.236314 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.236446 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.236637 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.236891 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.237016 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.237321 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.237742 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.237889 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.238423 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.238577 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.238703 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.238824 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.238957 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.239080 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.239216 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.239341 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.239471 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.239687 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.239810 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.239941 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.240063 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.240184 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.240306 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.240427 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.240579 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.240716 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.240892 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.241026 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.241241 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.241368 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.241571 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.241709 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.241879 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.242005 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.242193 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.242328 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.242516 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.242794 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.242923 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.243053 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.243184 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.243318 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.243452 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.243574 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.243779 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.243935 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.244085 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.244220 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.244412 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.244540 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.244726 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.244858 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.245040 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.245165 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.245351 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.245477 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.245680 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.245998 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.246323 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.246658 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.246801 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.246988 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.247115 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.247331 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.247457 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.247647 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.247781 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.247973 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.248100 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.248289 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.248436 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.248634 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.248768 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.248892 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.249013 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.249202 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.249328 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.249516 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.249644 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.249831 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.249956 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.250272 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.250417 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.250570 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.250695 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.250886 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.251013 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.251210 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.251346 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.251526 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.251660 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.251842 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.251969 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.252153 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.252293 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.252564 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.252691 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.253486 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.253617 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.253814 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.253991 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.254153 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.254368 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.254493 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.254733 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.254872 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.255078 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.255214 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.255405 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.255617 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.255748 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.255942 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.256079 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.256260 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.256386 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.256579 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.256705 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.256890 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.257026 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.257205 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.257333 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.257525 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.257643 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.257846 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.257974 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.258164 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.258298 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.258479 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.258638 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.258839 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.258968 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.259125 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.259254 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.259441 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.259567 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.259751 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.259879 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.260056 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.260181 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.260373 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.260611 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.260749 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.261004 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.261218 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.261347 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.261645 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.261778 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.261957 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.262083 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.262286 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.262424 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.262606 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.262809 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.262945 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.263225 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.263444 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.263582 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.263834 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.263967 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.264147 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.264272 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.264495 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.264619 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.264806 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.265112 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.265248 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.265448 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.265636 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.265761 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.266078 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.266210 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.266399 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.266734 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.266875 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.267070 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.267270 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.267395 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.267692 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.267816 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.268012 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.268286 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.268469 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.269280 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.269435 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.269614 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.269891 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.270019 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.270230 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.270410 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.270557 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.270884 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.271021 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.271198 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.271499 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.271627 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.271829 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.272045 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.272418 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.272554 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.272760 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.273320 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.273653 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.273981 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.274116 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.274304 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.274438 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.274680 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.274807 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.275013 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.275138 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.275338 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.275467 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.275659 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.275799 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.275975 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.276101 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.276288 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.276424 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.276599 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.276726 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.276914 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.277047 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.277230 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.277367 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.277661 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.277801 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.277958 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.278089 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.278278 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.278406 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.278646 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.278775 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.278898 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.279020 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.279239 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.279375 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.279498 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.279621 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.279815 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.280267 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.280405 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.280777 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.280905 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.281193 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.281591 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.281833 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.282006 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.282382 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.282508 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.282827 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.283047 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.283228 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.283399 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.283724 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.283860 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.284144 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.284273 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.284501 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.284630 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.284853 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.285030 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.285245 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.285478 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.285661 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.285880 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.286055 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.286208 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.286338 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.286493 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.286756 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.286901 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.287151 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.287412 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.287760 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.287875 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.288060 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.288201 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.288477 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.288779 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.288904 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.289219 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.289443 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.289615 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.289768 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.290020 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.290146 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.290514 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.290867 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.291186 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.291513 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.291651 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.291829 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.292033 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.292191 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.292424 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.292550 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.292814 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.292938 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.293129 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.293264 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.293444 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.293612 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.293819 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.294057 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.294193 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.294433 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.294611 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.294798 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.294927 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.295148 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.295288 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.295463 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.295652 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.295818 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.296080 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.296204 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.296388 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.296513 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.296698 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.296823 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.297008 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.297197 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.297337 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.297591 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.297730 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.297949 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.298074 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.298259 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.298470 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.298617 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.298897 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.299023 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.299214 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.299353 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.299565 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.299715 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.299971 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.300112 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.300286 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.300447 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.300613 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.300834 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.300960 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.301222 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.301349 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.301528 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.301661 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.301846 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.302010 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.302160 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.302445 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.302620 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.302799 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.302924 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.303112 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.303283 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.303422 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.303686 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.303820 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.304017 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.304142 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.304317 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.304530 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.304665 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.304915 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.305041 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.305246 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.305379 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.305575 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.305710 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.305892 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.306070 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.306217 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.306492 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.306661 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.306830 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.307020 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.307147 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.307411 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.307552 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.307734 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.307859 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.308082 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.308216 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.308404 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.308610 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.308738 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.309010 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.309134 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.309318 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.309444 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.309639 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.309836 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.309998 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.310244 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.310431 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.310630 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.310950 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.311114 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.311282 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.311509 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.311678 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.311836 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.311992 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.312162 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.312387 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.312513 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.312771 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.312904 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.313080 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.313218 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.313389 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.313591 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.313738 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.314060 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.314195 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.314402 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.314611 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.314739 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.315009 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.315136 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.315888 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.316024 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.316209 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.316336 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.316528 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.316730 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.316866 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.317117 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.317242 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.317442 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.317579 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.317759 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.317915 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.318076 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.318312 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.318431 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.318702 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.318829 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.319029 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.319186 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.319348 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.319592 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.319747 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.319978 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.320107 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.320305 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.320431 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.320633 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.320767 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.320945 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.321145 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.321270 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.321543 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.321677 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.321861 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.321985 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.322187 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.322312 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.322500 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.322748 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.322876 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.323143 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.323268 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.323459 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.323586 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.323776 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.323937 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.324167 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.324390 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.324524 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.324703 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.324829 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.325016 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.325176 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.325325 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.325574 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.325708 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.325949 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.326081 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.326255 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.326381 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.326585 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.326783 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.326911 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.327167 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.327293 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.327486 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.327619 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.327929 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.328053 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.328246 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.328370 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.328563 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.328763 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.328891 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.329172 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.329296 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.329756 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.329976 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.330123 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.330337 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.330465 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.330714 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.330986 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.331696 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.331863 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.332001 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.332263 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.332391 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.332617 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.332742 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.332940 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.333065 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.333218 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.333437 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.333564 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.333848 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.333973 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.334181 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.334389 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.334516 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.334790 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.334931 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.335122 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.335247 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.335430 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.335577 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.335755 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.335967 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.336198 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.336359 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.336515 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.336766 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.336892 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.337150 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.337284 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.337530 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.337662 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.337844 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.337984 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.338170 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.338303 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.338496 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.338765 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.338904 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.339149 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.339274 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.339466 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.339709 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.339834 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.340096 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.340239 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.340428 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.340553 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.340744 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.341016 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.341168 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.341353 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.341478 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.341678 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.341830 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.342004 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.342244 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.342369 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.342681 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.342824 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.343097 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.343230 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.343419 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.343543 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.343731 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.343934 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.344061 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.344334 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.344531 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.344658 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.344858 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.344983 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.345208 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.345338 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.345568 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.345693 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.345880 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.346010 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.346208 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.346373 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.346606 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.346940 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.347219 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.347352 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.347558 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.347683 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.347869 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.348004 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.348175 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.348375 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.348501 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.348796 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.348970 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.349110 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.349387 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.349514 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.349761 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.349886 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.350087 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.350300 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.350429 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.350644 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.350786 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.351036 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.351163 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.351345 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.351472 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.351653 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.351827 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.351954 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.352221 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.352348 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.352588 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.352713 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.352914 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.353042 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.353250 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.353385 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.353584 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.353757 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.353920 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.354150 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.354286 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.354592 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.354719 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.354914 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.355052 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.355233 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.355429 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.355556 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.355854 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.355980 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.356162 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.356300 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.356475 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.356678 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.356806 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.357072 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.357198 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.357379 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.357506 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.357691 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.357918 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.358044 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.358288 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.358423 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.358615 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.358748 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.358943 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.359188 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.359314 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.359559 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.359685 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.359872 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.359998 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.360185 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.360333 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.360519 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.360757 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.360886 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.361141 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.361267 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.361450 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.361607 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.361788 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.362021 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.362175 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.362476 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.362659 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.362834 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.363052 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.363180 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.363463 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.363597 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.363787 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.363913 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.364108 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.364269 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.364431 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.364696 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.364843 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.365059 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.365185 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.365382 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.365529 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.365702 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.365921 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.366055 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.366313 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.366440 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.366673 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.366814 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.366997 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.367124 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.367543 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.367669 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.367876 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.368009 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.368195 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.368322 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.368512 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.368718 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.368856 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.369135 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.369261 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.369453 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.369579 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.369773 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.369973 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.370108 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.370390 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.370563 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.370753 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.370878 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.371071 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.371199 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.371397 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.371594 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.371727 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.371978 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.372112 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.372353 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.372478 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.372669 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.372794 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.373037 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.373193 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.373357 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.373590 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.373740 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.373992 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.374118 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.374355 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.374480 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.374702 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.374904 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.375043 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.375269 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.375398 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.375621 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.375747 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.375937 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.376093 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.376253 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.376503 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.376630 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.376868 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.376992 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.377182 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.377309 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.377498 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.378303 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.378458 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.378685 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.379016 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.379202 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.379329 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.379646 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.379781 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.379963 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.380167 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.380294 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.380569 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.380809 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.381004 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.381182 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.381448 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.381779 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.381945 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.382102 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.382432 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.382652 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.382809 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.383010 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.383159 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.383384 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.383519 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.383695 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.383841 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.384010 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.384243 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.384371 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.384616 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.384741 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.384952 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.385164 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.385324 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.385556 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.385699 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.385879 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.386006 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.386194 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.386379 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.386752 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.386883 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.387111 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.387240 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.387434 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.387599 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.387768 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.388014 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.388142 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.388405 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.388529 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.388716 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.388850 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.389071 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.389198 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.389383 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.389615 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.389750 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.390004 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.390136 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.390319 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.390453 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.390668 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.390910 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.391057 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.391249 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.391377 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.391583 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.391707 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.391891 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.392058 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.392207 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.392455 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.392589 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.392834 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.392959 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.393144 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.393271 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.394014 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.394194 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.394329 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.394647 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.394778 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.394977 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.395179 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.395321 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.395499 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.395628 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.395875 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.396010 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.396194 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.396328 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.396503 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.396701 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.396828 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.397110 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.397243 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.397422 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.397547 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.397731 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.397903 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.398030 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.398299 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.398443 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.398719 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.398952 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.399090 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.399348 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.399477 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.399672 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.399840 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.399992 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.400286 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.400372 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.400622 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.400761 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.400951 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.401141 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.401289 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.401482 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.401622 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.401900 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.402150 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.402277 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.402488 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.402675 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.402823 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.403076 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.403215 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.403467 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.403593 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.403775 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.403910 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.404086 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.404274 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.404407 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.404664 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.404804 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.405008 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.405132 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.405340 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.405503 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.405639 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.405913 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.406041 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.406226 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.406589 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.406721 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.406964 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.407104 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.407281 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.407431 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.407596 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.407846 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.407973 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.408208 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.408416 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.408542 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.408665 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.408816 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.409174 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.409344 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.409587 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.409806 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.409933 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.410205 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.410386 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.410581 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.410710 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.410914 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.411077 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.411283 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.411486 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.411615 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.411837 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.411965 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.412148 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.412288 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.412467 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.412680 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.412814 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.413085 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.413211 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.413420 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.413545 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.413801 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.413934 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.414120 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.414246 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.414444 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.414695 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.414822 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.415084 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.415223 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.415416 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.415635 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.415808 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.416024 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.416164 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.416345 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.416485 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.416660 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.416847 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.416979 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.417232 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.417357 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.417619 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.417745 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.417968 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.418092 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.418279 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.418404 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.418608 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.418821 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.418947 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.419214 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.419341 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.419551 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.419677 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.419865 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.420055 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.420180 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.420445 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.420579 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.420760 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.420885 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.421067 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.421334 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.421480 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.421668 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.421796 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.421975 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.422110 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.422285 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.422445 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.422608 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.422873 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.423000 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.423203 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.423335 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.423528 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.423656 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.423836 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.424052 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.424188 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.424441 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.424600 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.424794 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.424937 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.425209 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.425337 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.425585 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.425888 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.426018 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.426196 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.426374 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.426564 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.426813 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.426955 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.427200 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.427334 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.427530 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.427664 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.427848 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.428022 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.428198 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.428405 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.428531 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.428788 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.428928 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.429135 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.429261 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.429455 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.429581 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.429777 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.430016 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.430146 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.430412 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.430557 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.430773 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.430898 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.431093 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.431223 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.431420 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.431691 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.431860 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.432034 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.432238 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.432373 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.432654 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.432781 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.432961 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.433094 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.433290 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.433439 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.433613 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.433841 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.433967 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.434233 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.434361 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.434592 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.434722 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.434899 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.435064 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.435217 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.435488 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.435630 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.435839 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.435967 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.436178 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.436306 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.436496 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.436718 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.436845 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.437115 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.437254 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.437442 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.437566 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.437771 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.437905 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.438085 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.438278 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.438404 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.438700 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.438841 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.439095 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.439233 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.439415 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.439544 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.439768 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.439893 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.440098 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.440813 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.441086 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.441312 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.441503 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.441699 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.441866 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.441992 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 23 11:35:28.442114 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.442468 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.442895 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.443234 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.443609 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.444027 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.444403 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.444771 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.445148 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.445535 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.445916 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.446288 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.446730 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.447091 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.447444 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.447805 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.448172 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.448527 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.448878 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.449234 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.449591 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.449941 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.450353 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.450747 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.451106 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.451470 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.451822 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.452170 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.452518 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.452867 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.453219 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.453571 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.453935 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.454289 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.454932 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.455289 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.455643 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.456577 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.457026 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.457412 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.457779 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.458153 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.458519 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.458923 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.459282 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.459659 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.460029 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.460450 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.460831 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.461286 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.461667 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.462050 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.462426 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.462847 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.463231 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.463616 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.464015 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.464418 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.464796 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.465195 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.465586 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.465977 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.466364 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.466911 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.467312 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.467695 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.468075 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.468460 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.468842 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.469224 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.469616 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.470002 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.470413 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.470850 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.471238 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.471730 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.472120 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.472531 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.472914 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.473326 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.473716 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.474190 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.474623 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.475029 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:35:28.475357 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110137) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 23 11:35:28.505689 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: INFO dbcounter [None req-f8afa8b6-e45e-46ba-85dd-c7e46ccd70dd None None] Registered counter for database nova_api Jun 23 11:35:28.618390 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG oslo_db.sqlalchemy.engines [None req-f8afa8b6-e45e-46ba-85dd-c7e46ccd70dd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110136) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 11:35:28.624833 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG dbcounter [-] [110136] Writer thread running {{(pid=110136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 11:35:28.631599 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: INFO dbcounter [None req-b1a828d7-6ce8-4af6-9ef6-30819447650c None None] Registered counter for database nova_api Jun 23 11:35:28.652519 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG oslo_db.sqlalchemy.engines [None req-b1a828d7-6ce8-4af6-9ef6-30819447650c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110137) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 11:35:28.658960 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG dbcounter [-] [110137] Writer thread running {{(pid=110137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 11:35:28.682430 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.context [None req-f8afa8b6-e45e-46ba-85dd-c7e46ccd70dd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),10257dc1-1bb0-429b-a4e0-3986d13353db(cell1) {{(pid=110136) load_cells /opt/stack/nova/nova/context.py:464}} Jun 23 11:35:28.686348 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG oslo_concurrency.lockutils [None req-f8afa8b6-e45e-46ba-85dd-c7e46ccd70dd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:35:28.687973 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG oslo_concurrency.lockutils [None req-f8afa8b6-e45e-46ba-85dd-c7e46ccd70dd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:35:28.688777 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG oslo_concurrency.lockutils [None req-f8afa8b6-e45e-46ba-85dd-c7e46ccd70dd None None] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:35:28.691621 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG oslo_concurrency.lockutils [None req-f8afa8b6-e45e-46ba-85dd-c7e46ccd70dd None None] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=110136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:35:28.693610 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: INFO dbcounter [None req-f8afa8b6-e45e-46ba-85dd-c7e46ccd70dd None None] Registered counter for database nova_cell0 Jun 23 11:35:28.697508 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: INFO dbcounter [None req-f8afa8b6-e45e-46ba-85dd-c7e46ccd70dd None None] Registered counter for database nova_cell1 Jun 23 11:35:28.705769 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG oslo_db.sqlalchemy.engines [None req-f8afa8b6-e45e-46ba-85dd-c7e46ccd70dd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110136) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 11:35:28.708550 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG oslo_db.sqlalchemy.engines [None req-f8afa8b6-e45e-46ba-85dd-c7e46ccd70dd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110136) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 11:35:28.714026 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG dbcounter [-] [110136] Writer thread running {{(pid=110136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 11:35:28.716141 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG dbcounter [-] [110136] Writer thread running {{(pid=110136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 11:35:28.718958 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.context [None req-b1a828d7-6ce8-4af6-9ef6-30819447650c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),10257dc1-1bb0-429b-a4e0-3986d13353db(cell1) {{(pid=110137) load_cells /opt/stack/nova/nova/context.py:464}} Jun 23 11:35:28.723536 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG oslo_concurrency.lockutils [None req-b1a828d7-6ce8-4af6-9ef6-30819447650c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:35:28.725121 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG oslo_concurrency.lockutils [None req-b1a828d7-6ce8-4af6-9ef6-30819447650c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:35:28.725919 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG oslo_concurrency.lockutils [None req-b1a828d7-6ce8-4af6-9ef6-30819447650c None None] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:35:28.727881 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG oslo_concurrency.lockutils [None req-b1a828d7-6ce8-4af6-9ef6-30819447650c None None] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110137) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:35:28.729844 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: INFO dbcounter [None req-b1a828d7-6ce8-4af6-9ef6-30819447650c None None] Registered counter for database nova_cell0 Jun 23 11:35:28.733854 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: INFO dbcounter [None req-b1a828d7-6ce8-4af6-9ef6-30819447650c None None] Registered counter for database nova_cell1 Jun 23 11:35:28.741071 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG oslo_db.sqlalchemy.engines [None req-b1a828d7-6ce8-4af6-9ef6-30819447650c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110137) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 11:35:28.742294 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG oslo_db.sqlalchemy.engines [None req-b1a828d7-6ce8-4af6-9ef6-30819447650c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110137) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 11:35:28.748862 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG dbcounter [-] [110137] Writer thread running {{(pid=110137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 11:35:28.750317 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG dbcounter [-] [110137] Writer thread running {{(pid=110137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 11:35:28.867363 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: INFO dbcounter [None req-f8afa8b6-e45e-46ba-85dd-c7e46ccd70dd None None] Registered counter for database nova_cell0 Jun 23 11:35:28.876095 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG oslo_db.sqlalchemy.engines [None req-f8afa8b6-e45e-46ba-85dd-c7e46ccd70dd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110136) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 11:35:28.881111 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG dbcounter [-] [110136] Writer thread running {{(pid=110136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 11:35:28.900003 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: INFO dbcounter [None req-b1a828d7-6ce8-4af6-9ef6-30819447650c None None] Registered counter for database nova_cell0 Jun 23 11:35:28.908061 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG oslo_db.sqlalchemy.engines [None req-b1a828d7-6ce8-4af6-9ef6-30819447650c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110137) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 11:35:28.912679 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG dbcounter [-] [110137] Writer thread running {{(pid=110137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 11:35:29.320278 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: WARNING keystonemiddleware.auth_token [None req-f8afa8b6-e45e-46ba-85dd-c7e46ccd70dd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 11:35:29.327508 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: WARNING keystonemiddleware.auth_token [None req-f8afa8b6-e45e-46ba-85dd-c7e46ccd70dd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 11:35:29.339092 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: WARNING keystonemiddleware.auth_token [None req-b1a828d7-6ce8-4af6-9ef6-30819447650c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 11:35:29.346240 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: WARNING keystonemiddleware.auth_token [None req-b1a828d7-6ce8-4af6-9ef6-30819447650c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 11:35:29.667107 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: WARNING keystonemiddleware.auth_token [None req-f8afa8b6-e45e-46ba-85dd-c7e46ccd70dd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 11:35:29.672917 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: WARNING keystonemiddleware.auth_token [None req-f8afa8b6-e45e-46ba-85dd-c7e46ccd70dd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 11:35:29.678690 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c7cdcf79c0 pid: 110136 (default app) Jun 23 11:35:29.687280 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi [None req-f8afa8b6-e45e-46ba-85dd-c7e46ccd70dd None None] Calling method '>' {{(pid=110136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:35:29.687280 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: INFO nova.api.openstack.requestlog [None req-f8afa8b6-e45e-46ba-85dd-c7e46ccd70dd None None] 10.222.0.13 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001722 Jun 23 11:35:29.687280 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: [pid: 110136|app: 0|req: 1/1] 10.222.0.13 () {50 vars in 788 bytes} [Thu Jun 23 11:35:29 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:35:29.687522 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: WARNING keystonemiddleware.auth_token [None req-b1a828d7-6ce8-4af6-9ef6-30819447650c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 11:35:29.691506 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: WARNING keystonemiddleware.auth_token [None req-b1a828d7-6ce8-4af6-9ef6-30819447650c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 11:35:29.696833 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c7cdcf79c0 pid: 110137 (default app) Jun 23 11:36:47.910971 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi [None req-f8afa8b6-e45e-46ba-85dd-c7e46ccd70dd None None] Calling method '>' {{(pid=110136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:36:47.912001 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: INFO nova.api.openstack.requestlog [None req-f8afa8b6-e45e-46ba-85dd-c7e46ccd70dd None None] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001554 Jun 23 11:36:47.912610 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: [pid: 110136|app: 0|req: 2/2] 10.222.0.13 () {54 vars in 930 bytes} [Thu Jun 23 11:36:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:36:47.939781 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG dbcounter [-] [110137] Writing DB stats nova_api:SELECT=3 {{(pid=110137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:36:47.941631 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG dbcounter [-] [110137] Writing DB stats nova_cell0:SELECT=3 {{(pid=110137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:36:47.942966 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG dbcounter [-] [110137] Writing DB stats nova_cell1:SELECT=3 {{(pid=110137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:36:47.944200 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG dbcounter [-] [110137] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:36:48.383476 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi [None req-a7606994-7498-4f3c-9388-d076251a4987 admin admin] Calling method '>' {{(pid=110137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:36:48.412936 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: INFO nova.api.openstack.requestlog [None req-a7606994-7498-4f3c-9388-d076251a4987 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.491547 Jun 23 11:36:48.413672 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: [pid: 110137|app: 0|req: 1/3] 10.222.0.13 () {60 vars in 1291 bytes} [Thu Jun 23 11:36:47 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:36:50.514337 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi [None req-f8afa8b6-e45e-46ba-85dd-c7e46ccd70dd None None] Calling method '>' {{(pid=110136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:36:50.516410 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: INFO nova.api.openstack.requestlog [None req-f8afa8b6-e45e-46ba-85dd-c7e46ccd70dd None None] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002498 Jun 23 11:36:50.518827 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: [pid: 110136|app: 0|req: 3/4] 10.222.0.13 () {54 vars in 930 bytes} [Thu Jun 23 11:36:50 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:36:50.580909 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi [None req-0cbec78d-7c6d-437f-9dd9-c31d104f6249 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "ram": 256, "os-flavor-access:is_public": true, "swap": 0, "disk": 1, "id": "c1"}} {{(pid=110137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:36:50.599832 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 11:36:50.599832 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: warnings.warn(msg) Jun 23 11:36:50.688300 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: INFO nova.api.openstack.requestlog [None req-0cbec78d-7c6d-437f-9dd9-c31d104f6249 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.165500 Jun 23 11:36:50.696228 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: [pid: 110137|app: 0|req: 2/5] 10.222.0.13 () {64 vars in 1282 bytes} [Thu Jun 23 11:36:50 2022] POST /compute/v2.1/flavors => generated 407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 23 11:36:50.705138 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG dbcounter [-] [110136] Writing DB stats nova_api:SELECT=3 {{(pid=110136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:36:50.706333 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG dbcounter [-] [110136] Writing DB stats nova_cell1:SELECT=3 {{(pid=110136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:36:50.707179 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG dbcounter [-] [110136] Writing DB stats nova_cell0:SELECT=3 {{(pid=110136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:36:50.708117 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG dbcounter [-] [110136] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:36:50.919060 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi [None req-821ed92d-1c0a-49a3-8bf1-cffb916c2383 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:36:50.921565 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 11:36:50.921565 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: warnings.warn(msg) Jun 23 11:36:51.085272 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: INFO nova.api.openstack.requestlog [None req-821ed92d-1c0a-49a3-8bf1-cffb916c2383 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.385839 Jun 23 11:36:51.086086 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: [pid: 110136|app: 0|req: 4/6] 10.222.0.13 () {64 vars in 1335 bytes} [Thu Jun 23 11:36:50 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:36:53.181748 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi [None req-0cbec78d-7c6d-437f-9dd9-c31d104f6249 admin admin] Calling method '>' {{(pid=110137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:36:53.182821 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: INFO nova.api.openstack.requestlog [None req-0cbec78d-7c6d-437f-9dd9-c31d104f6249 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Jun 23 11:36:53.183420 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: [pid: 110137|app: 0|req: 3/7] 10.222.0.13 () {54 vars in 930 bytes} [Thu Jun 23 11:36:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:36:53.287648 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi [None req-04a3d6f3-a38c-4b39-a334-9c187b0965bc admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "ds512M", "ram": 512, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1"}} {{(pid=110136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:36:53.305723 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 11:36:53.305723 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: warnings.warn(msg) Jun 23 11:36:53.420205 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: INFO nova.api.openstack.requestlog [None req-04a3d6f3-a38c-4b39-a334-9c187b0965bc admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.230739 Jun 23 11:36:53.420980 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: [pid: 110136|app: 0|req: 5/8] 10.222.0.13 () {64 vars in 1282 bytes} [Thu Jun 23 11:36:53 2022] POST /compute/v2.1/flavors => generated 404 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 11:36:53.433469 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi [None req-000ef863-b503-44be-8cd4-f0df563d5f68 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:36:53.434988 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 11:36:53.434988 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: warnings.warn(msg) Jun 23 11:36:53.515771 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: INFO nova.api.openstack.requestlog [None req-000ef863-b503-44be-8cd4-f0df563d5f68 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085877 Jun 23 11:36:53.516478 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: [pid: 110137|app: 0|req: 4/9] 10.222.0.13 () {64 vars in 1335 bytes} [Thu Jun 23 11:36:53 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:36:55.672633 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi [None req-04a3d6f3-a38c-4b39-a334-9c187b0965bc admin admin] Calling method '>' {{(pid=110136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:36:55.673672 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: INFO nova.api.openstack.requestlog [None req-04a3d6f3-a38c-4b39-a334-9c187b0965bc admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001526 Jun 23 11:36:55.674076 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: [pid: 110136|app: 0|req: 6/10] 10.222.0.13 () {54 vars in 930 bytes} [Thu Jun 23 11:36:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:36:55.733102 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi [None req-8e737973-06fb-4c6d-831b-2fdee2ec0bdf admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "ram": 1024, "name": "ds1G", "disk": 10, "os-flavor-access:is_public": true, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=110137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:36:55.826279 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: INFO nova.api.openstack.requestlog [None req-8e737973-06fb-4c6d-831b-2fdee2ec0bdf admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.146132 Jun 23 11:36:55.827189 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: [pid: 110137|app: 0|req: 5/11] 10.222.0.13 () {64 vars in 1282 bytes} [Thu Jun 23 11:36:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 11:36:55.839540 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi [None req-35eb3c9e-ce51-41b3-8957-69270f3eadb4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:36:55.948087 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: INFO nova.api.openstack.requestlog [None req-35eb3c9e-ce51-41b3-8957-69270f3eadb4 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.112186 Jun 23 11:36:55.948669 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: [pid: 110136|app: 0|req: 7/12] 10.222.0.13 () {64 vars in 1335 bytes} [Thu Jun 23 11:36:55 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:36:58.033564 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi [None req-8e737973-06fb-4c6d-831b-2fdee2ec0bdf admin admin] Calling method '>' {{(pid=110137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:36:58.035284 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: INFO nova.api.openstack.requestlog [None req-8e737973-06fb-4c6d-831b-2fdee2ec0bdf admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Jun 23 11:36:58.035284 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: [pid: 110137|app: 0|req: 6/13] 10.222.0.13 () {54 vars in 930 bytes} [Thu Jun 23 11:36:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:36:58.094731 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi [None req-3f94d750-3b9f-4a61-9fbe-84f8b6ecef64 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "os-flavor-access:is_public": true, "name": "ds2G", "rxtx_factor": 1.0, "swap": 0, "ram": 2048, "disk": 10}} {{(pid=110136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:36:58.173366 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: INFO nova.api.openstack.requestlog [None req-3f94d750-3b9f-4a61-9fbe-84f8b6ecef64 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.131899 Jun 23 11:36:58.174047 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: [pid: 110136|app: 0|req: 8/14] 10.222.0.13 () {64 vars in 1282 bytes} [Thu Jun 23 11:36:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 23 11:36:58.186198 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi [None req-03e0d5bb-aa23-418e-9fa1-3c694dc57f3c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:36:58.289559 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: INFO nova.api.openstack.requestlog [None req-03e0d5bb-aa23-418e-9fa1-3c694dc57f3c admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.107037 Jun 23 11:36:58.290057 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: [pid: 110137|app: 0|req: 7/15] 10.222.0.13 () {64 vars in 1335 bytes} [Thu Jun 23 11:36:58 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:37:00.412319 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi [None req-3f94d750-3b9f-4a61-9fbe-84f8b6ecef64 admin admin] Calling method '>' {{(pid=110136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:37:00.413311 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: INFO nova.api.openstack.requestlog [None req-3f94d750-3b9f-4a61-9fbe-84f8b6ecef64 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Jun 23 11:37:00.413708 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: [pid: 110136|app: 0|req: 9/16] 10.222.0.13 () {54 vars in 930 bytes} [Thu Jun 23 11:37:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:37:00.486351 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi [None req-24bf1556-13b3-4995-883c-0f9e5c6bbe16 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "vcpus": 4, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 20, "name": "ds4G", "ram": 4096, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=110137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:37:00.581117 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: INFO nova.api.openstack.requestlog [None req-24bf1556-13b3-4995-883c-0f9e5c6bbe16 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.160820 Jun 23 11:37:00.582743 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: [pid: 110137|app: 0|req: 8/17] 10.222.0.13 () {64 vars in 1282 bytes} [Thu Jun 23 11:37:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 11:37:00.594388 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi [None req-fea3badc-30c3-4f27-b82c-1673859b68a5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:37:00.720360 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: INFO nova.api.openstack.requestlog [None req-fea3badc-30c3-4f27-b82c-1673859b68a5 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.129493 Jun 23 11:37:00.720949 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: [pid: 110136|app: 0|req: 10/18] 10.222.0.13 () {64 vars in 1335 bytes} [Thu Jun 23 11:37:00 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:37:02.790012 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi [None req-24bf1556-13b3-4995-883c-0f9e5c6bbe16 admin admin] Calling method '>' {{(pid=110137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:37:02.791058 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: INFO nova.api.openstack.requestlog [None req-24bf1556-13b3-4995-883c-0f9e5c6bbe16 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Jun 23 11:37:02.791615 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: [pid: 110137|app: 0|req: 9/19] 10.222.0.13 () {54 vars in 930 bytes} [Thu Jun 23 11:37:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:37:02.848954 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi [None req-9732b449-0503-45f9-95ee-d795849c3076 admin admin] Calling method '>' {{(pid=110136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:37:02.872151 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: INFO nova.api.openstack.requestlog [None req-9732b449-0503-45f9-95ee-d795849c3076 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.074792 Jun 23 11:37:02.872695 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: [pid: 110136|app: 0|req: 11/20] 10.222.0.13 () {60 vars in 1291 bytes} [Thu Jun 23 11:37:02 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:37:05.080330 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi [None req-24bf1556-13b3-4995-883c-0f9e5c6bbe16 admin admin] Calling method '>' {{(pid=110137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:37:05.083214 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: INFO nova.api.openstack.requestlog [None req-24bf1556-13b3-4995-883c-0f9e5c6bbe16 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001928 Jun 23 11:37:05.083696 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: [pid: 110137|app: 0|req: 10/21] 10.222.0.13 () {54 vars in 930 bytes} [Thu Jun 23 11:37:05 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:37:05.147660 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi [None req-2db79cce-7112-4852-b586-3ff93f2c482c admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "disk": 1, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "id": "1", "name": "m1.tiny", "os-flavor-access:is_public": true}} {{(pid=110136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:37:05.214219 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: INFO nova.api.openstack.requestlog [None req-2db79cce-7112-4852-b586-3ff93f2c482c admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.123208 Jun 23 11:37:05.214793 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: [pid: 110136|app: 0|req: 12/22] 10.222.0.13 () {64 vars in 1282 bytes} [Thu Jun 23 11:37:05 2022] POST /compute/v2.1/flavors => generated 402 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 11:37:05.228468 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi [None req-c5b29e95-8c91-4935-bb66-f2916f01809c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:37:05.338155 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: INFO nova.api.openstack.requestlog [None req-c5b29e95-8c91-4935-bb66-f2916f01809c admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.113596 Jun 23 11:37:05.338894 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: [pid: 110137|app: 0|req: 11/23] 10.222.0.13 () {64 vars in 1332 bytes} [Thu Jun 23 11:37:05 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:37:08.047174 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi [None req-2db79cce-7112-4852-b586-3ff93f2c482c admin admin] Calling method '>' {{(pid=110136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:37:08.048592 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: INFO nova.api.openstack.requestlog [None req-2db79cce-7112-4852-b586-3ff93f2c482c admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001974 Jun 23 11:37:08.049095 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: [pid: 110136|app: 0|req: 13/24] 10.222.0.13 () {54 vars in 930 bytes} [Thu Jun 23 11:37:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:37:08.117905 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi [None req-e6ea78a5-76ac-4976-9c6c-033215eda046 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "vcpus": 1, "id": "2", "disk": 20, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=110137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:37:08.195869 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: INFO nova.api.openstack.requestlog [None req-e6ea78a5-76ac-4976-9c6c-033215eda046 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.139884 Jun 23 11:37:08.196433 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: [pid: 110137|app: 0|req: 12/25] 10.222.0.13 () {64 vars in 1282 bytes} [Thu Jun 23 11:37:08 2022] POST /compute/v2.1/flavors => generated 405 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 11:37:08.209228 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi [None req-a5c1b625-83cb-4acb-a085-a7ce81d6b1fd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:37:08.297553 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: INFO nova.api.openstack.requestlog [None req-a5c1b625-83cb-4acb-a085-a7ce81d6b1fd admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.092702 Jun 23 11:37:08.298070 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: [pid: 110136|app: 0|req: 14/26] 10.222.0.13 () {64 vars in 1332 bytes} [Thu Jun 23 11:37:08 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:37:10.379419 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi [None req-e6ea78a5-76ac-4976-9c6c-033215eda046 admin admin] Calling method '>' {{(pid=110137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:37:10.380530 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: INFO nova.api.openstack.requestlog [None req-e6ea78a5-76ac-4976-9c6c-033215eda046 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001560 Jun 23 11:37:10.381018 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: [pid: 110137|app: 0|req: 13/27] 10.222.0.13 () {54 vars in 930 bytes} [Thu Jun 23 11:37:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:37:10.439757 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi [None req-f7a57d29-99eb-4efa-aecf-5ada1a1133e3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "name": "m1.medium", "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "3", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40}} {{(pid=110136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:37:10.526697 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: INFO nova.api.openstack.requestlog [None req-f7a57d29-99eb-4efa-aecf-5ada1a1133e3 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.139683 Jun 23 11:37:10.527249 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: [pid: 110136|app: 0|req: 15/28] 10.222.0.13 () {64 vars in 1282 bytes} [Thu Jun 23 11:37:10 2022] POST /compute/v2.1/flavors => generated 406 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 23 11:37:10.539491 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi [None req-0c4a5581-e0e3-4e71-9043-3eeb6be88f05 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:37:10.657297 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: INFO nova.api.openstack.requestlog [None req-0c4a5581-e0e3-4e71-9043-3eeb6be88f05 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.121381 Jun 23 11:37:10.657915 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: [pid: 110137|app: 0|req: 14/29] 10.222.0.13 () {64 vars in 1332 bytes} [Thu Jun 23 11:37:10 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:37:12.771488 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi [None req-f7a57d29-99eb-4efa-aecf-5ada1a1133e3 admin admin] Calling method '>' {{(pid=110136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:37:12.772553 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: INFO nova.api.openstack.requestlog [None req-f7a57d29-99eb-4efa-aecf-5ada1a1133e3 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Jun 23 11:37:12.772994 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: [pid: 110136|app: 0|req: 16/30] 10.222.0.13 () {54 vars in 930 bytes} [Thu Jun 23 11:37:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:37:12.832157 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi [None req-ac07d519-9db8-42a6-adba-656c6bc34ed3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "swap": 0, "os-flavor-access:is_public": true, "vcpus": 4, "rxtx_factor": 1.0, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "ram": 8192}} {{(pid=110137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:37:12.918495 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: INFO nova.api.openstack.requestlog [None req-ac07d519-9db8-42a6-adba-656c6bc34ed3 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.139625 Jun 23 11:37:12.921851 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: [pid: 110137|app: 0|req: 15/31] 10.222.0.13 () {64 vars in 1282 bytes} [Thu Jun 23 11:37:12 2022] POST /compute/v2.1/flavors => generated 405 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 23 11:37:12.934496 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi [None req-5329845b-3a98-463d-8c41-64eea15ce3c2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:37:13.027962 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: INFO nova.api.openstack.requestlog [None req-5329845b-3a98-463d-8c41-64eea15ce3c2 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097022 Jun 23 11:37:13.028543 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: [pid: 110136|app: 0|req: 17/32] 10.222.0.13 () {64 vars in 1332 bytes} [Thu Jun 23 11:37:12 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:37:15.167067 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi [None req-ac07d519-9db8-42a6-adba-656c6bc34ed3 admin admin] Calling method '>' {{(pid=110137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:37:15.168338 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: INFO nova.api.openstack.requestlog [None req-ac07d519-9db8-42a6-adba-656c6bc34ed3 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001740 Jun 23 11:37:15.168817 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: [pid: 110137|app: 0|req: 16/33] 10.222.0.13 () {54 vars in 930 bytes} [Thu Jun 23 11:37:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:37:15.234600 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi [None req-d7608ee8-2f67-4a73-9eda-465c123dd918 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "ram": 16384, "disk": 160, "name": "m1.xlarge", "rxtx_factor": 1.0, "swap": 0, "vcpus": 8}} {{(pid=110136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:37:15.320303 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: INFO nova.api.openstack.requestlog [None req-d7608ee8-2f67-4a73-9eda-465c123dd918 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.145615 Jun 23 11:37:15.320855 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: [pid: 110136|app: 0|req: 18/34] 10.222.0.13 () {64 vars in 1282 bytes} [Thu Jun 23 11:37:15 2022] POST /compute/v2.1/flavors => generated 408 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 11:37:15.333985 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi [None req-83caec59-46bf-4cd8-8761-fae927ab7359 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:37:15.417686 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: INFO nova.api.openstack.requestlog [None req-83caec59-46bf-4cd8-8761-fae927ab7359 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.088383 Jun 23 11:37:15.418519 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: [pid: 110137|app: 0|req: 17/35] 10.222.0.13 () {64 vars in 1332 bytes} [Thu Jun 23 11:37:15 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:37:39.448827 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi [None req-d7608ee8-2f67-4a73-9eda-465c123dd918 admin admin] Calling method '>' {{(pid=110136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:37:39.449831 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: INFO nova.api.openstack.requestlog [None req-d7608ee8-2f67-4a73-9eda-465c123dd918 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Jun 23 11:37:39.450231 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: [pid: 110136|app: 0|req: 19/36] 10.222.0.13 () {54 vars in 930 bytes} [Thu Jun 23 11:37:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:37:39.461810 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG dbcounter [-] [110137] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=110137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:37:39.510596 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi [None req-21216221-4e1a-48ad-b6d1-70d5c5e210c1 admin admin] Calling method '>' {{(pid=110137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:37:39.528394 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: INFO nova.api.openstack.requestlog [None req-21216221-4e1a-48ad-b6d1-70d5c5e210c1 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.072371 Jun 23 11:37:39.528861 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: [pid: 110137|app: 0|req: 18/37] 10.222.0.13 () {60 vars in 1291 bytes} [Thu Jun 23 11:37:39 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:37:40.452499 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi [None req-d7608ee8-2f67-4a73-9eda-465c123dd918 admin admin] Calling method '>' {{(pid=110136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:37:40.453504 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: INFO nova.api.openstack.requestlog [None req-d7608ee8-2f67-4a73-9eda-465c123dd918 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Jun 23 11:37:40.453900 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: [pid: 110136|app: 0|req: 20/38] 10.222.0.13 () {56 vars in 1074 bytes} [Thu Jun 23 11:37:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:37:40.646439 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi [None req-a5984325-bea2-4de1-9ac7-438d1c7b8648 admin admin] Calling method '>' {{(pid=110137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:37:40.651882 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: INFO nova.api.openstack.wsgi [None req-a5984325-bea2-4de1-9ac7-438d1c7b8648 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 23 11:37:40.655175 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi [None req-a5984325-bea2-4de1-9ac7-438d1c7b8648 admin admin] Request method failure captured: Jun 23 11:37:40.655175 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 23 11:37:40.655175 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: Accept: application/json Jun 23 11:37:40.655175 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: Accept-Encoding: gzip, deflate Jun 23 11:37:40.655175 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: Connection: keep-alive Jun 23 11:37:40.655175 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: Content-Length: 0 Jun 23 11:37:40.655175 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: Host: 10.222.0.13 Jun 23 11:37:40.655175 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: Openstack-Api-Version: compute 2.90 Jun 23 11:37:40.655175 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: Openstack-System-Scope: None Jun 23 11:37:40.655175 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: User-Agent: python-novaclient Jun 23 11:37:40.655175 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: X-Auth-Token: gAAAAABitFCEWxxBFqIvzl2pj5HkXNP3SJvwIKq8YuVTNh4b2yoyrxb0vhfms9az2cD3-SMBzwyIim2dxN8QK5O8YeE3C1lkcavojQsAcjK4UQfUZ2T7vX7TMQwknZmxVe_hx-bI0ROwWOtka5U2-dkZKZTVe1fOolBHgkI_d8RxYo2KzYhesU0 Jun 23 11:37:40.655175 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: X-Domain-Id: None Jun 23 11:37:40.655175 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: X-Domain-Name: None Jun 23 11:37:40.655175 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: X-Identity-Status: Confirmed Jun 23 11:37:40.655175 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: X-Is-Admin-Project: True Jun 23 11:37:40.655175 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: X-Openstack-Nova-Api-Version: 2.90 Jun 23 11:37:40.655175 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: X-Project-Domain-Id: default Jun 23 11:37:40.655175 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: X-Project-Domain-Name: Default Jun 23 11:37:40.655175 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: X-Project-Id: 237fd59b9b4946f0a2bdfcf73db9274e Jun 23 11:37:40.655175 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: X-Project-Name: admin Jun 23 11:37:40.655175 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: X-Role: admin,reader,member Jun 23 11:37:40.655175 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: X-Roles: admin,reader,member Jun 23 11:37:40.656791 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_237fd59b9b4946f0a2bdfcf73db9274e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/237fd59b9b4946f0a2bdfcf73db9274e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/237fd59b9b4946f0a2bdfcf73db9274e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/237fd59b9b4946f0a2bdfcf73db9274e"}]}] Jun 23 11:37:40.656791 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: X-Tenant: admin Jun 23 11:37:40.656791 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: X-Tenant-Id: 237fd59b9b4946f0a2bdfcf73db9274e Jun 23 11:37:40.656791 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: X-Tenant-Name: admin Jun 23 11:37:40.656791 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: X-User: admin Jun 23 11:37:40.656791 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: X-User-Domain-Id: default Jun 23 11:37:40.656791 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: X-User-Domain-Name: Default Jun 23 11:37:40.656791 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: X-User-Id: d5118162f0624ca794a0f081b0c2cca5 Jun 23 11:37:40.656791 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: X-User-Name: admin Jun 23 11:37:40.656791 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: method: > Jun 23 11:37:40.656791 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: exception: Flavor 42 could not be found. Jun 23 11:37:40.656791 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: action_args: {'id': '42'} Jun 23 11:37:40.656791 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: {{(pid=110137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:37:40.656791 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:37:40.657866 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 23 11:37:40.657866 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 23 11:37:40.657866 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 23 11:37:40.657866 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 23 11:37:40.657866 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 23 11:37:40.657866 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 23 11:37:40.657866 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 23 11:37:40.657866 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 23 11:37:40.657866 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 23 11:37:40.657866 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:37:40.657866 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 23 11:37:40.657866 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 23 11:37:40.657866 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 23 11:37:40.657866 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi Jun 23 11:37:40.657866 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:37:40.657866 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi Jun 23 11:37:40.657866 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:37:40.657866 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:37:40.657866 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:37:40.659027 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:37:40.659027 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:37:40.659027 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:37:40.659027 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:37:40.659027 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 23 11:37:40.659027 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:37:40.659027 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 23 11:37:40.659027 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi Jun 23 11:37:40.659027 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:37:40.659027 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi Jun 23 11:37:40.659027 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:37:40.659027 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:37:40.659027 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:37:40.659027 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:37:40.659027 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:37:40.659027 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 23 11:37:40.659027 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi Jun 23 11:37:40.659027 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi [None req-a5984325-bea2-4de1-9ac7-438d1c7b8648 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:37:40.660987 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: INFO nova.api.openstack.requestlog [None req-a5984325-bea2-4de1-9ac7-438d1c7b8648 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.062628 Jun 23 11:37:40.660987 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: [pid: 110137|app: 0|req: 19/39] 10.222.0.13 () {60 vars in 1190 bytes} [Thu Jun 23 11:37:40 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 23 11:37:40.666747 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi [None req-1af00322-3e71-42f0-8f35-9ef43ce23b7b admin admin] Calling method '>' {{(pid=110136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:37:40.669654 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG dbcounter [-] [110136] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=110136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:37:40.688872 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: INFO nova.api.openstack.requestlog [None req-1af00322-3e71-42f0-8f35-9ef43ce23b7b admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025651 Jun 23 11:37:40.689451 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: [pid: 110136|app: 0|req: 21/40] 10.222.0.13 () {60 vars in 1210 bytes} [Thu Jun 23 11:37:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:37:40.698937 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi [None req-20cd19c4-40f9-42c8-afa1-98f3d8c5bd93 admin admin] Calling method '>' {{(pid=110137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:37:40.721990 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: INFO nova.api.openstack.requestlog [None req-20cd19c4-40f9-42c8-afa1-98f3d8c5bd93 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026536 Jun 23 11:37:40.722514 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: [pid: 110137|app: 0|req: 20/41] 10.222.0.13 () {60 vars in 1210 bytes} [Thu Jun 23 11:37:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:37:40.732831 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi [None req-abb23411-d5b4-4c13-8d21-05aad73b94cb admin admin] Calling method '>' {{(pid=110136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:37:40.738474 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: INFO nova.api.openstack.wsgi [None req-abb23411-d5b4-4c13-8d21-05aad73b94cb admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 23 11:37:40.741950 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi [None req-abb23411-d5b4-4c13-8d21-05aad73b94cb admin admin] Request method failure captured: Jun 23 11:37:40.741950 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 23 11:37:40.741950 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: Accept: application/json Jun 23 11:37:40.741950 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: Accept-Encoding: gzip, deflate Jun 23 11:37:40.741950 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: Connection: keep-alive Jun 23 11:37:40.741950 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: Content-Length: 0 Jun 23 11:37:40.741950 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: Host: 10.222.0.13 Jun 23 11:37:40.741950 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: Openstack-Api-Version: compute 2.90 Jun 23 11:37:40.741950 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: Openstack-System-Scope: None Jun 23 11:37:40.741950 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: User-Agent: python-novaclient Jun 23 11:37:40.741950 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: X-Auth-Token: gAAAAABitFCEWxxBFqIvzl2pj5HkXNP3SJvwIKq8YuVTNh4b2yoyrxb0vhfms9az2cD3-SMBzwyIim2dxN8QK5O8YeE3C1lkcavojQsAcjK4UQfUZ2T7vX7TMQwknZmxVe_hx-bI0ROwWOtka5U2-dkZKZTVe1fOolBHgkI_d8RxYo2KzYhesU0 Jun 23 11:37:40.741950 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: X-Domain-Id: None Jun 23 11:37:40.741950 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: X-Domain-Name: None Jun 23 11:37:40.741950 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: X-Identity-Status: Confirmed Jun 23 11:37:40.741950 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: X-Is-Admin-Project: True Jun 23 11:37:40.741950 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: X-Openstack-Nova-Api-Version: 2.90 Jun 23 11:37:40.741950 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: X-Project-Domain-Id: default Jun 23 11:37:40.741950 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: X-Project-Domain-Name: Default Jun 23 11:37:40.741950 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: X-Project-Id: 237fd59b9b4946f0a2bdfcf73db9274e Jun 23 11:37:40.741950 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: X-Project-Name: admin Jun 23 11:37:40.741950 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: X-Role: admin,reader,member Jun 23 11:37:40.741950 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: X-Roles: admin,reader,member Jun 23 11:37:40.746447 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_237fd59b9b4946f0a2bdfcf73db9274e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/237fd59b9b4946f0a2bdfcf73db9274e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/237fd59b9b4946f0a2bdfcf73db9274e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/237fd59b9b4946f0a2bdfcf73db9274e"}]}] Jun 23 11:37:40.746447 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: X-Tenant: admin Jun 23 11:37:40.746447 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: X-Tenant-Id: 237fd59b9b4946f0a2bdfcf73db9274e Jun 23 11:37:40.746447 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: X-Tenant-Name: admin Jun 23 11:37:40.746447 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: X-User: admin Jun 23 11:37:40.746447 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: X-User-Domain-Id: default Jun 23 11:37:40.746447 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: X-User-Domain-Name: Default Jun 23 11:37:40.746447 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: X-User-Id: d5118162f0624ca794a0f081b0c2cca5 Jun 23 11:37:40.746447 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: X-User-Name: admin Jun 23 11:37:40.746447 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: method: > Jun 23 11:37:40.746447 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: exception: Flavor 42 could not be found. Jun 23 11:37:40.746447 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: action_args: {'id': '42'} Jun 23 11:37:40.746447 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: {{(pid=110136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:37:40.746447 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:37:40.747454 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 23 11:37:40.747454 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 23 11:37:40.747454 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 23 11:37:40.747454 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 23 11:37:40.747454 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 23 11:37:40.747454 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 23 11:37:40.747454 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 23 11:37:40.747454 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 23 11:37:40.747454 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 23 11:37:40.747454 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:37:40.747454 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 23 11:37:40.747454 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 23 11:37:40.747454 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 23 11:37:40.747454 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi Jun 23 11:37:40.747454 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:37:40.747454 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi Jun 23 11:37:40.747454 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:37:40.747454 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:37:40.747454 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:37:40.748725 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:37:40.748725 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:37:40.748725 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:37:40.748725 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:37:40.748725 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 23 11:37:40.748725 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:37:40.748725 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 23 11:37:40.748725 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi Jun 23 11:37:40.748725 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:37:40.748725 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi Jun 23 11:37:40.748725 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:37:40.748725 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:37:40.748725 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:37:40.748725 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:37:40.748725 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:37:40.748725 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 23 11:37:40.748725 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi Jun 23 11:37:40.748725 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi [None req-abb23411-d5b4-4c13-8d21-05aad73b94cb admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110136) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:37:40.749967 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: INFO nova.api.openstack.requestlog [None req-abb23411-d5b4-4c13-8d21-05aad73b94cb admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014393 Jun 23 11:37:40.749967 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: [pid: 110136|app: 0|req: 22/42] 10.222.0.13 () {60 vars in 1190 bytes} [Thu Jun 23 11:37:40 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 23 11:37:41.566294 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi [None req-20cd19c4-40f9-42c8-afa1-98f3d8c5bd93 admin admin] Calling method '>' {{(pid=110137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:37:41.567784 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: INFO nova.api.openstack.requestlog [None req-20cd19c4-40f9-42c8-afa1-98f3d8c5bd93 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001898 Jun 23 11:37:41.568175 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: [pid: 110137|app: 0|req: 21/43] 10.222.0.13 () {56 vars in 1074 bytes} [Thu Jun 23 11:37:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:37:41.761146 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi [None req-eb61aca0-29ff-4acf-af8e-16a0c1439846 admin admin] Calling method '>' {{(pid=110136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:37:41.766812 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: INFO nova.api.openstack.wsgi [None req-eb61aca0-29ff-4acf-af8e-16a0c1439846 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 23 11:37:41.768289 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi [None req-eb61aca0-29ff-4acf-af8e-16a0c1439846 admin admin] Request method failure captured: Jun 23 11:37:41.768289 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 23 11:37:41.768289 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: Accept: application/json Jun 23 11:37:41.768289 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: Accept-Encoding: gzip, deflate Jun 23 11:37:41.768289 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: Connection: keep-alive Jun 23 11:37:41.768289 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: Content-Length: 0 Jun 23 11:37:41.768289 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: Host: 10.222.0.13 Jun 23 11:37:41.768289 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: Openstack-Api-Version: compute 2.90 Jun 23 11:37:41.768289 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: Openstack-System-Scope: None Jun 23 11:37:41.768289 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: User-Agent: python-novaclient Jun 23 11:37:41.768289 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: X-Auth-Token: gAAAAABitFCFWId6d2Egjohloc-ZdN2A255QRr1FfVKZUKg32uwA3m0XYxUdUkRp7w-DVzJSBcUb92kyOHacZcFNptqPysTOFyR8U4LTT11_dz6lxP47_sSyW5RM5U7pkiyJYefWocHlsFgqWnzbgnNaNjjJxrCAo5FoxM8wHDSqqi82F_Z0i2A Jun 23 11:37:41.768289 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: X-Domain-Id: None Jun 23 11:37:41.768289 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: X-Domain-Name: None Jun 23 11:37:41.768289 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: X-Identity-Status: Confirmed Jun 23 11:37:41.768289 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: X-Is-Admin-Project: True Jun 23 11:37:41.768289 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: X-Openstack-Nova-Api-Version: 2.90 Jun 23 11:37:41.768289 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: X-Project-Domain-Id: default Jun 23 11:37:41.768289 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: X-Project-Domain-Name: Default Jun 23 11:37:41.768289 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: X-Project-Id: 237fd59b9b4946f0a2bdfcf73db9274e Jun 23 11:37:41.768289 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: X-Project-Name: admin Jun 23 11:37:41.768289 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: X-Role: admin,reader,member Jun 23 11:37:41.768289 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: X-Roles: admin,reader,member Jun 23 11:37:41.770299 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_237fd59b9b4946f0a2bdfcf73db9274e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/237fd59b9b4946f0a2bdfcf73db9274e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/237fd59b9b4946f0a2bdfcf73db9274e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/237fd59b9b4946f0a2bdfcf73db9274e"}]}] Jun 23 11:37:41.770299 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: X-Tenant: admin Jun 23 11:37:41.770299 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: X-Tenant-Id: 237fd59b9b4946f0a2bdfcf73db9274e Jun 23 11:37:41.770299 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: X-Tenant-Name: admin Jun 23 11:37:41.770299 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: X-User: admin Jun 23 11:37:41.770299 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: X-User-Domain-Id: default Jun 23 11:37:41.770299 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: X-User-Domain-Name: Default Jun 23 11:37:41.770299 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: X-User-Id: d5118162f0624ca794a0f081b0c2cca5 Jun 23 11:37:41.770299 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: X-User-Name: admin Jun 23 11:37:41.770299 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: method: > Jun 23 11:37:41.770299 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: exception: Flavor 84 could not be found. Jun 23 11:37:41.770299 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: action_args: {'id': '84'} Jun 23 11:37:41.770299 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: {{(pid=110136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:37:41.770299 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:37:41.771132 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 23 11:37:41.771132 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 23 11:37:41.771132 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 23 11:37:41.771132 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 23 11:37:41.771132 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 23 11:37:41.771132 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 23 11:37:41.771132 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 23 11:37:41.771132 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 23 11:37:41.771132 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 23 11:37:41.771132 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:37:41.771132 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 23 11:37:41.771132 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 23 11:37:41.771132 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 23 11:37:41.771132 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi Jun 23 11:37:41.771132 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:37:41.771132 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi Jun 23 11:37:41.771132 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:37:41.771132 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:37:41.771132 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:37:41.778713 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:37:41.778713 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:37:41.778713 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:37:41.778713 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:37:41.778713 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 23 11:37:41.778713 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:37:41.778713 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 23 11:37:41.778713 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi Jun 23 11:37:41.778713 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:37:41.778713 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi Jun 23 11:37:41.778713 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:37:41.778713 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:37:41.778713 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:37:41.778713 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:37:41.778713 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:37:41.778713 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 23 11:37:41.778713 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi Jun 23 11:37:41.778713 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi [None req-eb61aca0-29ff-4acf-af8e-16a0c1439846 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110136) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:37:41.780110 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: INFO nova.api.openstack.requestlog [None req-eb61aca0-29ff-4acf-af8e-16a0c1439846 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.060433 Jun 23 11:37:41.780110 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: [pid: 110136|app: 0|req: 23/44] 10.222.0.13 () {60 vars in 1190 bytes} [Thu Jun 23 11:37:41 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 23 11:37:41.780335 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi [None req-f7e7903b-852c-449c-b6c5-67b163df7046 admin admin] Calling method '>' {{(pid=110137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:37:41.794861 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: INFO nova.api.openstack.requestlog [None req-f7e7903b-852c-449c-b6c5-67b163df7046 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018158 Jun 23 11:37:41.795389 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: [pid: 110137|app: 0|req: 22/45] 10.222.0.13 () {60 vars in 1210 bytes} [Thu Jun 23 11:37:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:37:41.805306 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi [None req-139b4b72-88fd-4bcb-9a56-fc6c60f8927c admin admin] Calling method '>' {{(pid=110136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:37:41.819628 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: INFO nova.api.openstack.requestlog [None req-139b4b72-88fd-4bcb-9a56-fc6c60f8927c admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018306 Jun 23 11:37:41.820167 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: [pid: 110136|app: 0|req: 24/46] 10.222.0.13 () {60 vars in 1210 bytes} [Thu Jun 23 11:37:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:37:41.829333 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi [None req-92fba479-3268-430b-b63d-4ec4c2476a06 admin admin] Calling method '>' {{(pid=110137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:37:41.836138 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: INFO nova.api.openstack.wsgi [None req-92fba479-3268-430b-b63d-4ec4c2476a06 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 23 11:37:41.837622 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi [None req-92fba479-3268-430b-b63d-4ec4c2476a06 admin admin] Request method failure captured: Jun 23 11:37:41.837622 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 23 11:37:41.837622 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: Accept: application/json Jun 23 11:37:41.837622 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: Accept-Encoding: gzip, deflate Jun 23 11:37:41.837622 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: Connection: keep-alive Jun 23 11:37:41.837622 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: Content-Length: 0 Jun 23 11:37:41.837622 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: Host: 10.222.0.13 Jun 23 11:37:41.837622 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: Openstack-Api-Version: compute 2.90 Jun 23 11:37:41.837622 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: Openstack-System-Scope: None Jun 23 11:37:41.837622 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: User-Agent: python-novaclient Jun 23 11:37:41.837622 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: X-Auth-Token: gAAAAABitFCFWId6d2Egjohloc-ZdN2A255QRr1FfVKZUKg32uwA3m0XYxUdUkRp7w-DVzJSBcUb92kyOHacZcFNptqPysTOFyR8U4LTT11_dz6lxP47_sSyW5RM5U7pkiyJYefWocHlsFgqWnzbgnNaNjjJxrCAo5FoxM8wHDSqqi82F_Z0i2A Jun 23 11:37:41.837622 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: X-Domain-Id: None Jun 23 11:37:41.837622 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: X-Domain-Name: None Jun 23 11:37:41.837622 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: X-Identity-Status: Confirmed Jun 23 11:37:41.837622 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: X-Is-Admin-Project: True Jun 23 11:37:41.837622 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: X-Openstack-Nova-Api-Version: 2.90 Jun 23 11:37:41.837622 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: X-Project-Domain-Id: default Jun 23 11:37:41.837622 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: X-Project-Domain-Name: Default Jun 23 11:37:41.837622 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: X-Project-Id: 237fd59b9b4946f0a2bdfcf73db9274e Jun 23 11:37:41.837622 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: X-Project-Name: admin Jun 23 11:37:41.837622 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: X-Role: admin,reader,member Jun 23 11:37:41.837622 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: X-Roles: admin,reader,member Jun 23 11:37:41.839165 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_237fd59b9b4946f0a2bdfcf73db9274e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/237fd59b9b4946f0a2bdfcf73db9274e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/237fd59b9b4946f0a2bdfcf73db9274e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/237fd59b9b4946f0a2bdfcf73db9274e"}]}] Jun 23 11:37:41.839165 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: X-Tenant: admin Jun 23 11:37:41.839165 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: X-Tenant-Id: 237fd59b9b4946f0a2bdfcf73db9274e Jun 23 11:37:41.839165 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: X-Tenant-Name: admin Jun 23 11:37:41.839165 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: X-User: admin Jun 23 11:37:41.839165 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: X-User-Domain-Id: default Jun 23 11:37:41.839165 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: X-User-Domain-Name: Default Jun 23 11:37:41.839165 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: X-User-Id: d5118162f0624ca794a0f081b0c2cca5 Jun 23 11:37:41.839165 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: X-User-Name: admin Jun 23 11:37:41.839165 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: method: > Jun 23 11:37:41.839165 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: exception: Flavor 84 could not be found. Jun 23 11:37:41.839165 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: action_args: {'id': '84'} Jun 23 11:37:41.839165 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: {{(pid=110137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:37:41.839165 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:37:41.840080 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 23 11:37:41.840080 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 23 11:37:41.840080 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 23 11:37:41.840080 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 23 11:37:41.840080 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 23 11:37:41.840080 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 23 11:37:41.840080 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 23 11:37:41.840080 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 23 11:37:41.840080 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 23 11:37:41.840080 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:37:41.840080 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 23 11:37:41.840080 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 23 11:37:41.840080 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 23 11:37:41.840080 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi Jun 23 11:37:41.840080 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:37:41.840080 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi Jun 23 11:37:41.840080 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:37:41.840080 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:37:41.840080 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:37:41.841255 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:37:41.841255 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:37:41.841255 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:37:41.841255 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:37:41.841255 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 23 11:37:41.841255 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:37:41.841255 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 23 11:37:41.841255 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi Jun 23 11:37:41.841255 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:37:41.841255 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi Jun 23 11:37:41.841255 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:37:41.841255 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:37:41.841255 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:37:41.841255 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:37:41.841255 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:37:41.841255 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 23 11:37:41.841255 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi Jun 23 11:37:41.841255 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi [None req-92fba479-3268-430b-b63d-4ec4c2476a06 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:37:41.842282 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: INFO nova.api.openstack.requestlog [None req-92fba479-3268-430b-b63d-4ec4c2476a06 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.013134 Jun 23 11:37:41.842282 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: [pid: 110137|app: 0|req: 23/47] 10.222.0.13 () {60 vars in 1190 bytes} [Thu Jun 23 11:37:41 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 23 11:37:42.654098 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi [None req-139b4b72-88fd-4bcb-9a56-fc6c60f8927c admin admin] Calling method '>' {{(pid=110136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:37:42.655146 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: INFO nova.api.openstack.requestlog [None req-139b4b72-88fd-4bcb-9a56-fc6c60f8927c admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Jun 23 11:37:42.655538 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: [pid: 110136|app: 0|req: 25/48] 10.222.0.13 () {56 vars in 1074 bytes} [Thu Jun 23 11:37:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:37:42.848966 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi [None req-f15a98d3-187d-4e47-98d1-ed2f8adaae7f admin admin] Calling method '>' {{(pid=110137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:37:42.854330 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: INFO nova.api.openstack.wsgi [None req-f15a98d3-187d-4e47-98d1-ed2f8adaae7f admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 23 11:37:42.856024 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi [None req-f15a98d3-187d-4e47-98d1-ed2f8adaae7f admin admin] Request method failure captured: Jun 23 11:37:42.856024 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 23 11:37:42.856024 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: Accept: application/json Jun 23 11:37:42.856024 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: Accept-Encoding: gzip, deflate Jun 23 11:37:42.856024 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: Connection: keep-alive Jun 23 11:37:42.856024 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: Content-Length: 0 Jun 23 11:37:42.856024 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: Host: 10.222.0.13 Jun 23 11:37:42.856024 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: Openstack-Api-Version: compute 2.90 Jun 23 11:37:42.856024 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: Openstack-System-Scope: None Jun 23 11:37:42.856024 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: User-Agent: python-novaclient Jun 23 11:37:42.856024 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: X-Auth-Token: gAAAAABitFCG2lPGvUFsWUpDCHRpfprX-685W-D0ND_J9fT5sl94sJP_IYCOTAw2Cy3JsSaGZFKCXEKIm05xjgvT1dwHVT6kxxMY25mTKIXDfPlJX0omJl0SV2veI-0WZjfPzk_Zh3t2fhQe9EC14P5Q27D4brZ7glPf_NIGiBTE8fg5fqjPfsw Jun 23 11:37:42.856024 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: X-Domain-Id: None Jun 23 11:37:42.856024 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: X-Domain-Name: None Jun 23 11:37:42.856024 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: X-Identity-Status: Confirmed Jun 23 11:37:42.856024 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: X-Is-Admin-Project: True Jun 23 11:37:42.856024 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: X-Openstack-Nova-Api-Version: 2.90 Jun 23 11:37:42.856024 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: X-Project-Domain-Id: default Jun 23 11:37:42.856024 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: X-Project-Domain-Name: Default Jun 23 11:37:42.856024 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: X-Project-Id: 237fd59b9b4946f0a2bdfcf73db9274e Jun 23 11:37:42.856024 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: X-Project-Name: admin Jun 23 11:37:42.856024 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: X-Role: admin,reader,member Jun 23 11:37:42.856024 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: X-Roles: admin,reader,member Jun 23 11:37:42.857589 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_237fd59b9b4946f0a2bdfcf73db9274e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/237fd59b9b4946f0a2bdfcf73db9274e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/237fd59b9b4946f0a2bdfcf73db9274e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/237fd59b9b4946f0a2bdfcf73db9274e"}]}] Jun 23 11:37:42.857589 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: X-Tenant: admin Jun 23 11:37:42.857589 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: X-Tenant-Id: 237fd59b9b4946f0a2bdfcf73db9274e Jun 23 11:37:42.857589 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: X-Tenant-Name: admin Jun 23 11:37:42.857589 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: X-User: admin Jun 23 11:37:42.857589 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: X-User-Domain-Id: default Jun 23 11:37:42.857589 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: X-User-Domain-Name: Default Jun 23 11:37:42.857589 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: X-User-Id: d5118162f0624ca794a0f081b0c2cca5 Jun 23 11:37:42.857589 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: X-User-Name: admin Jun 23 11:37:42.857589 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: method: > Jun 23 11:37:42.857589 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: exception: Flavor 451 could not be found. Jun 23 11:37:42.857589 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: action_args: {'id': '451'} Jun 23 11:37:42.857589 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: {{(pid=110137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:37:42.857589 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:37:42.858668 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 23 11:37:42.858668 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 23 11:37:42.858668 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 23 11:37:42.858668 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 23 11:37:42.858668 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 23 11:37:42.858668 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 23 11:37:42.858668 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 23 11:37:42.858668 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 23 11:37:42.858668 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 23 11:37:42.858668 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:37:42.858668 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 23 11:37:42.858668 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 23 11:37:42.858668 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 23 11:37:42.858668 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi Jun 23 11:37:42.858668 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:37:42.858668 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi Jun 23 11:37:42.858668 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:37:42.858668 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:37:42.858668 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:37:42.860045 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:37:42.860045 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:37:42.860045 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:37:42.860045 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:37:42.860045 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 23 11:37:42.860045 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:37:42.860045 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 23 11:37:42.860045 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi Jun 23 11:37:42.860045 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:37:42.860045 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi Jun 23 11:37:42.860045 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:37:42.860045 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:37:42.860045 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:37:42.860045 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:37:42.860045 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:37:42.860045 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 23 11:37:42.860045 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: ERROR nova.api.openstack.wsgi Jun 23 11:37:42.860045 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi [None req-f15a98d3-187d-4e47-98d1-ed2f8adaae7f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110137) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:37:42.861256 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: INFO nova.api.openstack.requestlog [None req-f15a98d3-187d-4e47-98d1-ed2f8adaae7f admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.066837 Jun 23 11:37:42.861256 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: [pid: 110137|app: 0|req: 24/49] 10.222.0.13 () {60 vars in 1193 bytes} [Thu Jun 23 11:37:42 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 23 11:37:42.867211 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi [None req-2061d10f-26d4-4177-8c26-b51d11e5c295 admin admin] Calling method '>' {{(pid=110136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:37:42.881894 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: INFO nova.api.openstack.requestlog [None req-2061d10f-26d4-4177-8c26-b51d11e5c295 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018300 Jun 23 11:37:42.882420 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: [pid: 110136|app: 0|req: 26/50] 10.222.0.13 () {60 vars in 1210 bytes} [Thu Jun 23 11:37:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:37:42.892185 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi [None req-a7c928fa-00ce-4ec8-9617-1fc2dce4a387 admin admin] Calling method '>' {{(pid=110137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:37:42.906086 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: INFO nova.api.openstack.requestlog [None req-a7c928fa-00ce-4ec8-9617-1fc2dce4a387 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017895 Jun 23 11:37:42.906626 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: [pid: 110137|app: 0|req: 25/51] 10.222.0.13 () {60 vars in 1210 bytes} [Thu Jun 23 11:37:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:37:42.915634 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi [None req-eec1768b-23c2-4039-89e8-379f19a35b84 admin admin] Calling method '>' {{(pid=110136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:37:42.920887 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: INFO nova.api.openstack.wsgi [None req-eec1768b-23c2-4039-89e8-379f19a35b84 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 23 11:37:42.922365 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi [None req-eec1768b-23c2-4039-89e8-379f19a35b84 admin admin] Request method failure captured: Jun 23 11:37:42.922365 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 23 11:37:42.922365 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: Accept: application/json Jun 23 11:37:42.922365 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: Accept-Encoding: gzip, deflate Jun 23 11:37:42.922365 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: Connection: keep-alive Jun 23 11:37:42.922365 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: Content-Length: 0 Jun 23 11:37:42.922365 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: Host: 10.222.0.13 Jun 23 11:37:42.922365 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: Openstack-Api-Version: compute 2.90 Jun 23 11:37:42.922365 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: Openstack-System-Scope: None Jun 23 11:37:42.922365 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: User-Agent: python-novaclient Jun 23 11:37:42.922365 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: X-Auth-Token: gAAAAABitFCG2lPGvUFsWUpDCHRpfprX-685W-D0ND_J9fT5sl94sJP_IYCOTAw2Cy3JsSaGZFKCXEKIm05xjgvT1dwHVT6kxxMY25mTKIXDfPlJX0omJl0SV2veI-0WZjfPzk_Zh3t2fhQe9EC14P5Q27D4brZ7glPf_NIGiBTE8fg5fqjPfsw Jun 23 11:37:42.922365 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: X-Domain-Id: None Jun 23 11:37:42.922365 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: X-Domain-Name: None Jun 23 11:37:42.922365 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: X-Identity-Status: Confirmed Jun 23 11:37:42.922365 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: X-Is-Admin-Project: True Jun 23 11:37:42.922365 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: X-Openstack-Nova-Api-Version: 2.90 Jun 23 11:37:42.922365 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: X-Project-Domain-Id: default Jun 23 11:37:42.922365 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: X-Project-Domain-Name: Default Jun 23 11:37:42.922365 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: X-Project-Id: 237fd59b9b4946f0a2bdfcf73db9274e Jun 23 11:37:42.922365 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: X-Project-Name: admin Jun 23 11:37:42.922365 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: X-Role: admin,reader,member Jun 23 11:37:42.922365 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: X-Roles: admin,reader,member Jun 23 11:37:42.923941 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_237fd59b9b4946f0a2bdfcf73db9274e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/237fd59b9b4946f0a2bdfcf73db9274e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/237fd59b9b4946f0a2bdfcf73db9274e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/237fd59b9b4946f0a2bdfcf73db9274e"}]}] Jun 23 11:37:42.923941 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: X-Tenant: admin Jun 23 11:37:42.923941 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: X-Tenant-Id: 237fd59b9b4946f0a2bdfcf73db9274e Jun 23 11:37:42.923941 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: X-Tenant-Name: admin Jun 23 11:37:42.923941 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: X-User: admin Jun 23 11:37:42.923941 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: X-User-Domain-Id: default Jun 23 11:37:42.923941 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: X-User-Domain-Name: Default Jun 23 11:37:42.923941 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: X-User-Id: d5118162f0624ca794a0f081b0c2cca5 Jun 23 11:37:42.923941 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: X-User-Name: admin Jun 23 11:37:42.923941 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: method: > Jun 23 11:37:42.923941 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: exception: Flavor 451 could not be found. Jun 23 11:37:42.923941 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: action_args: {'id': '451'} Jun 23 11:37:42.923941 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: {{(pid=110136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:37:42.923941 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:37:42.925121 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 23 11:37:42.925121 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 23 11:37:42.925121 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 23 11:37:42.925121 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 23 11:37:42.925121 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 23 11:37:42.925121 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 23 11:37:42.925121 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 23 11:37:42.925121 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 23 11:37:42.925121 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 23 11:37:42.925121 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:37:42.925121 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 23 11:37:42.925121 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 23 11:37:42.925121 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 23 11:37:42.925121 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi Jun 23 11:37:42.925121 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:37:42.925121 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi Jun 23 11:37:42.925121 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:37:42.925121 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:37:42.925121 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:37:42.926507 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:37:42.926507 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:37:42.926507 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:37:42.926507 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:37:42.926507 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 23 11:37:42.926507 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:37:42.926507 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 23 11:37:42.926507 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi Jun 23 11:37:42.926507 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:37:42.926507 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi Jun 23 11:37:42.926507 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:37:42.926507 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:37:42.926507 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:37:42.926507 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:37:42.926507 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:37:42.926507 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 23 11:37:42.926507 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: ERROR nova.api.openstack.wsgi Jun 23 11:37:42.926507 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi [None req-eec1768b-23c2-4039-89e8-379f19a35b84 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110136) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:37:42.927854 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: INFO nova.api.openstack.requestlog [None req-eec1768b-23c2-4039-89e8-379f19a35b84 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011529 Jun 23 11:37:42.927854 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: [pid: 110136|app: 0|req: 27/52] 10.222.0.13 () {60 vars in 1193 bytes} [Thu Jun 23 11:37:42 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 23 11:37:43.746075 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi [None req-a7c928fa-00ce-4ec8-9617-1fc2dce4a387 admin admin] Calling method '>' {{(pid=110137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:37:43.747133 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: INFO nova.api.openstack.requestlog [None req-a7c928fa-00ce-4ec8-9617-1fc2dce4a387 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Jun 23 11:37:43.747532 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: [pid: 110137|app: 0|req: 26/53] 10.222.0.13 () {56 vars in 1074 bytes} [Thu Jun 23 11:37:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:37:43.938882 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi [None req-bea1da50-1719-447c-9c60-f25f012200ab admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:37:44.041022 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: INFO nova.api.openstack.requestlog [None req-bea1da50-1719-447c-9c60-f25f012200ab admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.154257 Jun 23 11:37:44.041509 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: [pid: 110136|app: 0|req: 28/54] 10.222.0.13 () {64 vars in 1235 bytes} [Thu Jun 23 11:37:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 11:37:44.863923 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi [None req-a7c928fa-00ce-4ec8-9617-1fc2dce4a387 admin admin] Calling method '>' {{(pid=110137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:37:44.864935 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: INFO nova.api.openstack.requestlog [None req-a7c928fa-00ce-4ec8-9617-1fc2dce4a387 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Jun 23 11:37:44.865402 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: [pid: 110137|app: 0|req: 27/55] 10.222.0.13 () {56 vars in 1074 bytes} [Thu Jun 23 11:37:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:37:45.053607 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi [None req-2a1193b2-ad3c-4874-8a6d-5e8c7e0d928e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:37:45.102905 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: INFO nova.api.openstack.requestlog [None req-2a1193b2-ad3c-4874-8a6d-5e8c7e0d928e admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.099827 Jun 23 11:37:45.103349 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: [pid: 110136|app: 0|req: 29/56] 10.222.0.13 () {64 vars in 1235 bytes} [Thu Jun 23 11:37:45 2022] POST /compute/v2.1/flavors => generated 405 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 11:37:45.923499 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi [None req-a7c928fa-00ce-4ec8-9617-1fc2dce4a387 admin admin] Calling method '>' {{(pid=110137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:37:45.924500 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: INFO nova.api.openstack.requestlog [None req-a7c928fa-00ce-4ec8-9617-1fc2dce4a387 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 Jun 23 11:37:45.924898 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: [pid: 110137|app: 0|req: 28/57] 10.222.0.13 () {56 vars in 1074 bytes} [Thu Jun 23 11:37:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:37:46.116020 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi [None req-078632c7-6720-4fd8-8f87-39df157c9e25 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:37:46.212878 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: INFO nova.api.openstack.requestlog [None req-078632c7-6720-4fd8-8f87-39df157c9e25 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.148513 Jun 23 11:37:46.213331 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: [pid: 110136|app: 0|req: 30/58] 10.222.0.13 () {64 vars in 1235 bytes} [Thu Jun 23 11:37:46 2022] POST /compute/v2.1/flavors => generated 407 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 11:37:47.045902 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi [None req-a7c928fa-00ce-4ec8-9617-1fc2dce4a387 admin admin] Calling method '>' {{(pid=110137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:37:47.046936 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: INFO nova.api.openstack.requestlog [None req-a7c928fa-00ce-4ec8-9617-1fc2dce4a387 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Jun 23 11:37:47.047331 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: [pid: 110137|app: 0|req: 29/59] 10.222.0.13 () {56 vars in 1074 bytes} [Thu Jun 23 11:37:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:37:47.237356 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi [None req-4b910924-6295-49fd-952b-ed4a2fdb1d03 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:37:47.311180 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: INFO nova.api.openstack.requestlog [None req-4b910924-6295-49fd-952b-ed4a2fdb1d03 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.125418 Jun 23 11:37:47.311645 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: [pid: 110136|app: 0|req: 31/60] 10.222.0.13 () {64 vars in 1235 bytes} [Thu Jun 23 11:37:47 2022] POST /compute/v2.1/flavors => generated 409 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 11:37:48.131930 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi [None req-a7c928fa-00ce-4ec8-9617-1fc2dce4a387 admin admin] Calling method '>' {{(pid=110137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:37:48.132934 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: INFO nova.api.openstack.requestlog [None req-a7c928fa-00ce-4ec8-9617-1fc2dce4a387 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Jun 23 11:37:48.133328 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: [pid: 110137|app: 0|req: 30/61] 10.222.0.13 () {56 vars in 1074 bytes} [Thu Jun 23 11:37:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:37:48.324206 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi [None req-d9b596cc-e70b-4de1-a62a-73e33fd6beb2 admin admin] Calling method '>' {{(pid=110136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:37:48.343208 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: INFO nova.api.openstack.requestlog [None req-d9b596cc-e70b-4de1-a62a-73e33fd6beb2 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.071283 Jun 23 11:37:48.343735 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: [pid: 110136|app: 0|req: 32/62] 10.222.0.13 () {60 vars in 1202 bytes} [Thu Jun 23 11:37:48 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:38:35.955235 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi [None req-a7c928fa-00ce-4ec8-9617-1fc2dce4a387 admin admin] Calling method '>' {{(pid=110137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:38:35.956502 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: INFO nova.api.openstack.requestlog [None req-a7c928fa-00ce-4ec8-9617-1fc2dce4a387 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Jun 23 11:38:35.956898 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: [pid: 110137|app: 0|req: 31/63] 10.222.0.13 () {54 vars in 930 bytes} [Thu Jun 23 11:38:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:38:35.963952 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG dbcounter [-] [110136] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=110136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:38:36.015295 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi [None req-b58f69d4-a2db-44c7-8151-d1360fe88251 admin admin] Calling method '>' {{(pid=110136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:38:36.034742 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: INFO nova.api.openstack.requestlog [None req-b58f69d4-a2db-44c7-8151-d1360fe88251 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.071041 Jun 23 11:38:36.035290 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: [pid: 110136|app: 0|req: 33/64] 10.222.0.13 () {60 vars in 1291 bytes} [Thu Jun 23 11:38:35 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:38:36.058461 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi [None req-9e0de254-b677-440c-b1be-9744f2d52f94 admin admin] Calling method '>' {{(pid=110137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:38:36.061940 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG dbcounter [-] [110137] Writing DB stats nova_api:SELECT=14 {{(pid=110137) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:38:36.067123 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: INFO nova.api.openstack.requestlog [None req-9e0de254-b677-440c-b1be-9744f2d52f94 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012275 Jun 23 11:38:36.067656 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: [pid: 110137|app: 0|req: 32/65] 10.222.0.13 () {60 vars in 1282 bytes} [Thu Jun 23 11:38:36 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:38:36.079518 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi [None req-bb1fd952-1c83-4b34-a8ef-b05c69392386 admin admin] Calling method '>' {{(pid=110136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:38:36.087620 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: INFO nova.api.openstack.requestlog [None req-bb1fd952-1c83-4b34-a8ef-b05c69392386 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011768 Jun 23 11:38:36.088137 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: [pid: 110136|app: 0|req: 34/66] 10.222.0.13 () {60 vars in 1285 bytes} [Thu Jun 23 11:38:36 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:38:36.099826 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi [None req-b65c3339-ec55-4976-b95c-42a0d18fc031 admin admin] Calling method '>' {{(pid=110137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:38:36.107588 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: INFO nova.api.openstack.requestlog [None req-b65c3339-ec55-4976-b95c-42a0d18fc031 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011811 Jun 23 11:38:36.108100 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: [pid: 110137|app: 0|req: 33/67] 10.222.0.13 () {60 vars in 1285 bytes} [Thu Jun 23 11:38:36 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:38:36.120110 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi [None req-b65c636c-a659-4f62-93a5-22ca67f3b7e0 admin admin] Calling method '>' {{(pid=110136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:38:36.127701 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: INFO nova.api.openstack.requestlog [None req-b65c636c-a659-4f62-93a5-22ca67f3b7e0 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011146 Jun 23 11:38:36.128248 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: [pid: 110136|app: 0|req: 35/68] 10.222.0.13 () {60 vars in 1282 bytes} [Thu Jun 23 11:38:36 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:42:03.978173 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi [None req-b65c3339-ec55-4976-b95c-42a0d18fc031 admin admin] Calling method '>' {{(pid=110137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:42:03.979323 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: INFO nova.api.openstack.requestlog [None req-b65c3339-ec55-4976-b95c-42a0d18fc031 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001604 Jun 23 11:42:03.979787 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: [pid: 110137|app: 0|req: 34/69] 10.222.0.13 () {56 vars in 1074 bytes} [Thu Jun 23 11:42:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:42:04.132316 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG dbcounter [-] [110136] Writing DB stats nova_api:SELECT=6 {{(pid=110136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:04.245559 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi [None req-8f406b7e-d3ed-460f-a5e0-13c8cf07ef1d admin admin] Calling method '>' {{(pid=110136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:42:04.246739 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 11:42:04.246739 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: warnings.warn(msg) Jun 23 11:42:04.247922 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG oslo_concurrency.lockutils [None req-8f406b7e-d3ed-460f-a5e0-13c8cf07ef1d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:42:04.248386 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG oslo_concurrency.lockutils [None req-8f406b7e-d3ed-460f-a5e0-13c8cf07ef1d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:42:04.249158 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG oslo_concurrency.lockutils [None req-8f406b7e-d3ed-460f-a5e0-13c8cf07ef1d admin admin] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:42:04.249578 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG oslo_concurrency.lockutils [None req-8f406b7e-d3ed-460f-a5e0-13c8cf07ef1d admin admin] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:42:04.284253 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: INFO nova.api.openstack.requestlog [None req-8f406b7e-d3ed-460f-a5e0-13c8cf07ef1d admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.153366 Jun 23 11:42:04.284803 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: [pid: 110136|app: 0|req: 36/70] 10.222.0.13 () {60 vars in 1193 bytes} [Thu Jun 23 11:42:04 2022] GET /compute/v2.1/os-services => generated 791 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 11:42:05.121170 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi [None req-b65c3339-ec55-4976-b95c-42a0d18fc031 admin admin] Calling method '>' {{(pid=110137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:42:05.122310 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: INFO nova.api.openstack.requestlog [None req-b65c3339-ec55-4976-b95c-42a0d18fc031 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001523 Jun 23 11:42:05.128387 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: [pid: 110137|app: 0|req: 35/71] 10.222.0.13 () {56 vars in 1074 bytes} [Thu Jun 23 11:42:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:42:05.313296 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi [None req-85c19fae-63d4-4d86-87cd-1b978f1c4c93 admin admin] Calling method '>' {{(pid=110136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:42:05.314454 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 11:42:05.314454 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: warnings.warn(msg) Jun 23 11:42:05.315647 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG oslo_concurrency.lockutils [None req-85c19fae-63d4-4d86-87cd-1b978f1c4c93 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:42:05.316080 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG oslo_concurrency.lockutils [None req-85c19fae-63d4-4d86-87cd-1b978f1c4c93 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:42:05.317327 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG oslo_concurrency.lockutils [None req-85c19fae-63d4-4d86-87cd-1b978f1c4c93 admin admin] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:42:05.317750 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG oslo_concurrency.lockutils [None req-85c19fae-63d4-4d86-87cd-1b978f1c4c93 admin admin] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:42:05.337674 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: INFO nova.api.openstack.requestlog [None req-85c19fae-63d4-4d86-87cd-1b978f1c4c93 admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.076280 Jun 23 11:42:05.338145 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: [pid: 110136|app: 0|req: 37/72] 10.222.0.13 () {60 vars in 1193 bytes} [Thu Jun 23 11:42:05 2022] GET /compute/v2.1/os-services => generated 791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 11:42:16.696679 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi [None req-b65c3339-ec55-4976-b95c-42a0d18fc031 admin admin] Calling method '>' {{(pid=110137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:42:16.697678 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: INFO nova.api.openstack.requestlog [None req-b65c3339-ec55-4976-b95c-42a0d18fc031 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Jun 23 11:42:16.698063 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: [pid: 110137|app: 0|req: 36/73] 10.222.0.13 () {56 vars in 1074 bytes} [Thu Jun 23 11:42:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:42:16.846143 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG dbcounter [-] [110136] Writing DB stats nova_cell0:SELECT=4 {{(pid=110136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:16.846962 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG dbcounter [-] [110136] Writing DB stats nova_cell1:SELECT=4 {{(pid=110136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:16.847689 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG dbcounter [-] [110136] Writing DB stats nova_api:SELECT=8 {{(pid=110136) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:42:16.895499 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi [None req-6d5ceaac-39a8-48a9-9dd2-b46ab01335ca admin admin] Calling method '>' {{(pid=110136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:42:16.897231 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 11:42:16.897231 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: warnings.warn(msg) Jun 23 11:42:16.898458 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG oslo_concurrency.lockutils [None req-6d5ceaac-39a8-48a9-9dd2-b46ab01335ca admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:42:16.898977 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG oslo_concurrency.lockutils [None req-6d5ceaac-39a8-48a9-9dd2-b46ab01335ca admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:42:16.899783 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG oslo_concurrency.lockutils [None req-6d5ceaac-39a8-48a9-9dd2-b46ab01335ca admin admin] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:42:16.900198 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG oslo_concurrency.lockutils [None req-6d5ceaac-39a8-48a9-9dd2-b46ab01335ca admin admin] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:42:16.925274 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: INFO nova.api.openstack.requestlog [None req-6d5ceaac-39a8-48a9-9dd2-b46ab01335ca admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.083687 Jun 23 11:42:16.925990 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: [pid: 110136|app: 0|req: 38/74] 10.222.0.13 () {60 vars in 1193 bytes} [Thu Jun 23 11:42:16 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:42:17.747027 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: DEBUG nova.api.openstack.wsgi [None req-b65c3339-ec55-4976-b95c-42a0d18fc031 admin admin] Calling method '>' {{(pid=110137) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:42:17.748024 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: INFO nova.api.openstack.requestlog [None req-b65c3339-ec55-4976-b95c-42a0d18fc031 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Jun 23 11:42:17.748415 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: [pid: 110137|app: 0|req: 37/75] 10.222.0.13 () {56 vars in 1074 bytes} [Thu Jun 23 11:42:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:42:17.939893 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG nova.api.openstack.wsgi [None req-edc6f92e-6cd5-4c0d-84a2-ce1626689238 admin admin] Calling method '>' {{(pid=110136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:42:17.940987 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 11:42:17.940987 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: warnings.warn(msg) Jun 23 11:42:17.942198 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG oslo_concurrency.lockutils [None req-edc6f92e-6cd5-4c0d-84a2-ce1626689238 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:42:17.942672 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG oslo_concurrency.lockutils [None req-edc6f92e-6cd5-4c0d-84a2-ce1626689238 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:42:17.944066 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG oslo_concurrency.lockutils [None req-edc6f92e-6cd5-4c0d-84a2-ce1626689238 admin admin] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:42:17.944535 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: DEBUG oslo_concurrency.lockutils [None req-edc6f92e-6cd5-4c0d-84a2-ce1626689238 admin admin] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:42:17.966460 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: INFO nova.api.openstack.requestlog [None req-edc6f92e-6cd5-4c0d-84a2-ce1626689238 admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.077629 Jun 23 11:42:17.967313 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: [pid: 110136|app: 0|req: 39/76] 10.222.0.13 () {60 vars in 1193 bytes} [Thu Jun 23 11:42:17 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:43:13.718022 dv-cinder-820994-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 23 11:43:13.719011 dv-cinder-820994-2-iscsi devstack@n-api.service[110135]: Thu Jun 23 11:43:13 2022 - graceful shutdown triggered... Jun 23 11:43:13.719487 dv-cinder-820994-2-iscsi devstack@n-api.service[110136]: Gracefully killing worker 1 (pid: 110136)... Jun 23 11:43:13.719851 dv-cinder-820994-2-iscsi devstack@n-api.service[110137]: Gracefully killing worker 2 (pid: 110137)... Jun 23 11:43:14.720159 dv-cinder-820994-2-iscsi devstack@n-api.service[110135]: worker 1 buried after 1 seconds Jun 23 11:43:14.720667 dv-cinder-820994-2-iscsi devstack@n-api.service[110135]: worker 2 buried after 1 seconds Jun 23 11:43:14.720667 dv-cinder-820994-2-iscsi devstack@n-api.service[110135]: goodbye to uWSGI. Jun 23 11:43:14.721726 dv-cinder-820994-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 23 11:43:14.722280 dv-cinder-820994-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 23 11:43:14.725122 dv-cinder-820994-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 23 11:43:14.735041 dv-cinder-820994-2-iscsi devstack@n-api.service[124653]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 23 11:43:14.737611 dv-cinder-820994-2-iscsi devstack@n-api.service[124653]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 23 11:43:14 2022] *** Jun 23 11:43:14.737762 dv-cinder-820994-2-iscsi devstack@n-api.service[124653]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 23 11:43:14.737885 dv-cinder-820994-2-iscsi devstack@n-api.service[124653]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 23 11:43:14.737997 dv-cinder-820994-2-iscsi devstack@n-api.service[124653]: nodename: dv-cinder-820994-2-iscsi Jun 23 11:43:14.738113 dv-cinder-820994-2-iscsi devstack@n-api.service[124653]: machine: x86_64 Jun 23 11:43:14.738222 dv-cinder-820994-2-iscsi devstack@n-api.service[124653]: clock source: unix Jun 23 11:43:14.738339 dv-cinder-820994-2-iscsi devstack@n-api.service[124653]: pcre jit disabled Jun 23 11:43:14.738449 dv-cinder-820994-2-iscsi devstack@n-api.service[124653]: detected number of CPU cores: 4 Jun 23 11:43:14.738594 dv-cinder-820994-2-iscsi devstack@n-api.service[124653]: current working directory: / Jun 23 11:43:14.738706 dv-cinder-820994-2-iscsi devstack@n-api.service[124653]: detected binary path: /usr/bin/uwsgi-core Jun 23 11:43:14.738858 dv-cinder-820994-2-iscsi devstack@n-api.service[124653]: your processes number limit is 47680 Jun 23 11:43:14.738858 dv-cinder-820994-2-iscsi devstack@n-api.service[124653]: your memory page size is 4096 bytes Jun 23 11:43:14.738858 dv-cinder-820994-2-iscsi devstack@n-api.service[124653]: detected max file descriptor number: 2048 Jun 23 11:43:14.738858 dv-cinder-820994-2-iscsi devstack@n-api.service[124653]: lock engine: pthread robust mutexes Jun 23 11:43:14.739192 dv-cinder-820994-2-iscsi devstack@n-api.service[124653]: thunder lock: enabled Jun 23 11:43:14.739192 dv-cinder-820994-2-iscsi devstack@n-api.service[124653]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 23 11:43:14.739331 dv-cinder-820994-2-iscsi devstack@n-api.service[124653]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 23 11:43:14.783892 dv-cinder-820994-2-iscsi devstack@n-api.service[124653]: Python main interpreter initialized at 0x56471e0c89c0 Jun 23 11:43:14.783892 dv-cinder-820994-2-iscsi devstack@n-api.service[124653]: python threads support enabled Jun 23 11:43:14.783892 dv-cinder-820994-2-iscsi devstack@n-api.service[124653]: your server socket listen backlog is limited to 100 connections Jun 23 11:43:14.783892 dv-cinder-820994-2-iscsi devstack@n-api.service[124653]: your mercy for graceful operations on workers is 90 seconds Jun 23 11:43:14.784353 dv-cinder-820994-2-iscsi devstack@n-api.service[124653]: mapped 403077 bytes (393 KB) for 2 cores Jun 23 11:43:14.784353 dv-cinder-820994-2-iscsi devstack@n-api.service[124653]: *** Operational MODE: preforking *** Jun 23 11:43:14.784603 dv-cinder-820994-2-iscsi devstack@n-api.service[124653]: *** uWSGI is running in multiple interpreter mode *** Jun 23 11:43:14.784603 dv-cinder-820994-2-iscsi devstack@n-api.service[124653]: spawned uWSGI master process (pid: 124653) Jun 23 11:43:14.784810 dv-cinder-820994-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 23 11:43:14.790579 dv-cinder-820994-2-iscsi devstack@n-api.service[124653]: spawned uWSGI worker 1 (pid: 124669, cores: 1) Jun 23 11:43:14.790579 dv-cinder-820994-2-iscsi devstack@n-api.service[124653]: spawned uWSGI worker 2 (pid: 124670, cores: 1) Jun 23 11:43:14.790579 dv-cinder-820994-2-iscsi devstack@n-api.service[124653]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 23 11:43:15.448886 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 23 11:43:15.449547 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 23 11:43:16.664703 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 11:43:16.664703 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: from cryptography.utils import int_from_bytes Jun 23 11:43:16.665341 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 11:43:16.665341 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: from cryptography.utils import int_from_bytes Jun 23 11:43:16.680113 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 11:43:16.680113 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: from cryptography.utils import int_from_bytes Jun 23 11:43:16.680659 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 11:43:16.680659 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: from cryptography.utils import int_from_bytes Jun 23 11:43:19.095361 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 23 11:43:19.095361 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 23 11:43:19.096025 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 23 11:43:19.096276 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 23 11:43:19.096465 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 23 11:43:19.096864 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.097194 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.097519 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.097836 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.098169 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.098625 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.098954 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.099276 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.099602 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.099862 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.100190 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.100504 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-820994-2-iscsi {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.100823 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.101131 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.101441 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.101761 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.102065 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.102388 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.102717 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.103225 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.104601 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.104601 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.104601 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.105010 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.105258 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.105528 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.105845 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.106154 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.106479 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.106834 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.107236 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-820994-2-iscsi {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.107541 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.107852 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.108180 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.109172 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.109489 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.109799 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.110116 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.110438 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.110823 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.111155 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.111477 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.111786 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.112104 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.112408 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.112715 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.113022 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.113349 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.113641 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.113940 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.114190 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.114493 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.114833 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.115153 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.115477 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.115728 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.115976 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.116295 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.116603 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.116911 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.117214 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.117522 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.117825 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.118130 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.118437 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.118768 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.119073 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.119389 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.119701 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.120019 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.120322 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.120637 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.121044 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.121294 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.121598 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.121941 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.122257 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.122597 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.122916 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.123236 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.123703 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.124536 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.124845 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.125162 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.125496 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.125799 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.126049 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.126348 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.126675 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.126992 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.127299 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.127601 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.127905 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.128209 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.128515 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.128818 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.129120 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.129420 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.129722 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.130027 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.130329 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.130649 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.130970 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.131272 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.131587 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.131898 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.132195 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.132497 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.132799 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.133286 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.133595 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.133899 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.134219 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.134523 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.134863 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.135181 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.135486 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.135789 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.136103 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.136400 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.136704 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.137018 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.137323 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.137628 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.137930 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.138230 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.138391 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 23 11:43:19.138987 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.139136 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 23 11:43:19.139288 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.139432 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 23 11:43:19.140211 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.140449 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 23 11:43:19.140685 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.140685 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.140974 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 23 11:43:19.141139 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.141139 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.141418 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.141571 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.141715 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.141856 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.142006 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.142157 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.142322 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.142480 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.142647 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.142822 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.142970 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.143130 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.143291 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.143440 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.143584 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.143740 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.143890 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.144040 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.144206 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.144352 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.144529 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.144686 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.144840 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-820994-2-iscsi {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.145004 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.145174 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.145330 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.145514 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.145662 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.145812 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.145965 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.146116 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.146267 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.146417 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.146598 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.146758 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.146912 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.147504 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.147668 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.147668 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.148011 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.148954 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.149112 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.149112 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.149402 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.149548 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.149708 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.149869 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.150014 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.150170 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.150314 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.150464 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.150634 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.150798 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.150955 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.151108 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.151303 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.151303 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.151594 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.151750 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.151893 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.152045 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.152197 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-820994-2-iscsi {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.152349 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.152492 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.152643 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.152795 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.152939 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.153080 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.153377 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.153377 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.153673 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.153673 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.153983 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.154134 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.154286 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.154434 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.154664 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.154825 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.154971 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.155151 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.155403 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.155567 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.155722 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.155886 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.156031 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.156182 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.156332 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.156482 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.156678 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.156828 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.156978 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.157134 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.157701 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.157936 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.158085 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.158236 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.158392 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.158563 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.158715 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.159098 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.159316 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.159472 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.159624 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.159778 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.159923 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.160076 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.160231 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.160375 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.160524 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.160686 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.160853 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.161011 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.161166 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.161317 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.161464 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.161669 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.161937 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.162095 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.162249 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.162393 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.162621 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.162773 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.162929 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.163072 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.163224 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.163392 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.163623 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.163802 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.163949 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.164177 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.164323 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.164466 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.164608 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.164776 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.164928 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.165078 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.165230 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.165373 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.165522 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.165522 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.165808 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.165950 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.166092 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.166241 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.166393 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.166565 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.166743 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.166888 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.167038 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.167181 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.167331 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.167670 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.167912 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.168148 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.168305 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.168458 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.168615 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.168759 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.168937 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.169238 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.169397 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.169545 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.169698 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.169841 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.169983 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.170134 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.170276 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.170418 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.170621 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.170835 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.171044 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.171233 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.171408 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.171564 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.171721 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.171721 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.172030 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.172177 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.172329 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.172474 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.172620 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.172805 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.172956 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.173123 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.173281 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.173427 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.173600 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.173831 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.173991 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.174145 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.174290 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.174290 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.174290 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.174752 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.174898 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.175042 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.175193 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.175349 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.175504 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.175648 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.175808 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.175960 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.176113 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.176265 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.176423 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.176592 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.176743 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.176896 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.177048 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.177203 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.177369 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.177523 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.177898 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.178223 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.178376 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.178564 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.178719 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.178866 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.179011 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.179186 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.179534 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.179534 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.179837 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.179992 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.180153 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.180300 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.180444 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.180632 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.180789 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.180936 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.181095 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.181243 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.181387 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.181539 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.181684 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.181847 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.182003 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.182157 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.182309 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.182463 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.182631 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.182837 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.182994 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.182994 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.183321 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.183480 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.183627 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.183782 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.184038 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.184199 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.184346 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.184489 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.184635 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.184793 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.184946 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.185091 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.185237 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.185381 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.185532 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.185773 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.185932 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.186088 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.186234 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.186955 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.187113 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.187276 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.187455 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.187615 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.187927 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.188080 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.188331 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.188491 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.188644 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.188809 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.188971 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.189132 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:43:19.189294 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.189616 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.189770 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.189915 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.190060 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.190216 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.190380 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.190552 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.190713 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.190872 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.191032 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.191184 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.191339 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.191485 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.191655 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.191867 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.192024 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.192024 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.192024 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.192440 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.192585 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.192729 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.192873 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.193037 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.193182 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.193326 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.193470 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.193615 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.193759 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.193911 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.194073 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.194290 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.194449 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.194648 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.194812 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.194976 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.195129 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.195274 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.195426 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.195426 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.195719 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.195886 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.196035 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.196179 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.196322 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.196466 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.196620 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.196766 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.196921 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.197083 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.197228 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.197372 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.197544 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.197691 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.197863 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.198161 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.198334 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.198569 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.198737 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.198885 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.199040 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.199213 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.199365 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.199549 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.199860 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.200022 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.200180 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.200340 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.200498 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.200671 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.200828 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.200981 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.201140 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.201300 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.201465 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.201632 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.201792 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.201946 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.202678 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.202841 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.202994 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.203164 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.203318 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.203477 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.203628 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.203790 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.203966 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.204170 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.204409 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.204568 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.204728 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.204888 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.205050 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.205204 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.205362 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.205362 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.205662 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.205825 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.205992 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.206180 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.206336 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.206488 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.206678 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.206840 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.207002 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.207155 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.207324 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.207603 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.207763 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.207930 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.208219 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.208380 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.208562 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.208562 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.208562 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.208562 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.209413 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.209565 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.209769 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.210076 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.210076 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.210397 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.210601 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.210778 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.210950 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.211122 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.211282 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.211449 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.211609 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.211768 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.211929 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.212087 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.212248 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.212402 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.212581 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.212785 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.212952 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.213127 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.213286 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.213445 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.213598 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.213748 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.213934 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.214094 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.214247 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.214424 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.214679 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.214852 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.215005 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.215164 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.215334 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.215497 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.215659 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.215824 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.215976 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.216134 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.216286 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.216447 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.216609 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.216836 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.216997 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.216997 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.217285 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.217456 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.218269 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.218513 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.218793 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.218955 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.219108 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.219259 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.219421 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.219590 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.219743 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.219901 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.220230 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.220400 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.220579 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.220750 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.220912 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.221072 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.221231 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.221383 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.221544 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.221703 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.221870 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.222022 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.222174 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.222325 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.222497 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.222620 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.222710 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.222795 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.222878 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.222975 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.223061 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.223144 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.223235 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.223327 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.223414 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.223506 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.223598 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.223683 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.223773 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.223858 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.223941 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.224037 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.224037 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.224190 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.224274 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.224363 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.224454 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.224551 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.224658 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.224743 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.224827 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.224916 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.225014 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.225106 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.225215 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.225306 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.225390 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.225390 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.225558 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.225650 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.225734 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.225822 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.225906 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.225988 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.226082 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.226174 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.226264 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.226348 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.226429 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.226511 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.226631 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.226724 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.226807 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.226897 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.226987 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.227081 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.227165 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.227247 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.227337 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.227421 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.227503 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.227594 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.227677 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.227910 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.228003 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.228087 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.228180 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.228286 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.228382 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.228483 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.228575 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.228667 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.228757 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.228850 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.228943 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.229028 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.229028 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.229189 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.229280 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.229364 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.229455 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.229540 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.229623 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.229712 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.229804 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.229888 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.229986 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.230078 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.230403 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.230500 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.230618 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.230708 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.230792 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.230874 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.230964 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.231047 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.231149 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.231241 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.231326 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.231416 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.231522 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.231622 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.231708 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.231798 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.231883 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.231972 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.232057 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.232148 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.232239 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.232331 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.232422 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.232505 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.232587 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.232681 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.232767 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.232849 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.232939 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.233133 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.233223 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.234069 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.234277 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.234574 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.234878 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.234975 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.235204 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.235335 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.235519 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.235667 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.235833 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.235989 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.236152 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.236307 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.236458 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.236631 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.236776 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.236957 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.237088 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.237280 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.237402 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.237599 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.237692 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.237918 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.238068 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.238244 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.238351 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.238584 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.238738 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.238887 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.239022 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.239195 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.239353 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.239516 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.239661 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.239847 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.239992 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.240166 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.240540 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.240540 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.240806 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.240953 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.241086 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.241216 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.241355 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.241486 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.241617 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.241757 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.241890 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.242027 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.242158 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.242288 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.242419 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.242637 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.242764 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.242877 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.242987 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.243181 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.243392 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.243527 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.243666 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.243820 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.243961 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.244082 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.244222 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.244361 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.244500 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.244707 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.244847 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.245002 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.245141 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.245263 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.245410 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.245573 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.245715 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.245878 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.246041 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.246187 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.246360 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.246497 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.246702 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.246919 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.247057 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.247232 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.247374 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.247543 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.247677 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.247846 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.248121 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.248261 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.248399 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.248531 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.248669 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.248815 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.248975 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.249142 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.249417 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.249552 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.249736 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.249990 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.250134 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.250311 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.250636 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.250777 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.251027 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.251171 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.251320 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.251459 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.251630 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.251767 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.251944 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.252080 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.252272 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.252408 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.252579 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.252725 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.252870 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.252998 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.253182 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.253331 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.253505 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.253650 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.253812 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.253961 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.254135 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.254279 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.254546 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.254684 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.254868 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.255016 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.255174 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.255316 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.255482 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.255617 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.255792 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.255927 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.256101 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.256250 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.256416 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.256561 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.256728 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.256873 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.257040 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.257184 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.257348 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.257485 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.257655 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.257792 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.257974 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.258241 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.258376 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.258506 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.258687 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.258822 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.258966 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.259106 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.259237 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.259376 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.259507 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.259648 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.259814 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.259952 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.260120 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.260264 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.260429 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.260718 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.260857 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.260994 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.261127 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.261264 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.261393 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.261539 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.261726 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.261864 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.262069 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.262203 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.262379 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.262523 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.262712 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.262838 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.263020 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.263165 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.263333 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.263477 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.263639 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.263774 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.263940 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.264095 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.264241 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.264372 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.264593 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.264737 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.264912 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.265084 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.265232 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.265407 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.265551 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.265725 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.265861 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.266044 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.266193 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.266361 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.266504 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.266697 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.266813 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.267003 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.267140 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.267314 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.267444 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.267635 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.267763 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.267951 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.268074 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.268336 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.268461 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.268605 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.268745 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.268891 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.269024 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.269155 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.269285 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.269456 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.269603 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.269745 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.269874 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.270068 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.270216 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.270377 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.270524 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.270835 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.270972 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.271111 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.271251 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.271383 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.271529 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.271661 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.271791 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.271922 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.272051 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.272192 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.272334 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.272524 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.272661 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.272841 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.272984 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.273150 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.273301 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.273456 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.273695 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.273832 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.274010 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.274156 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.274325 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.274460 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.274637 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.274771 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.274948 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.275101 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.275242 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.275383 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.275551 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.275694 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.275840 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.275982 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.276148 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.276292 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.276454 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.276604 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.276782 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.276924 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.277089 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.277239 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.277380 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.277519 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.277690 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.277827 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.277997 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.278133 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.278404 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.278569 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.278795 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.278938 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.278938 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.279189 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.279319 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.279456 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.279598 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.279730 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.279860 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.279990 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.280660 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.280956 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.281103 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.281323 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.281470 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.281646 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.281795 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.281975 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.282119 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.282295 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.282430 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.282643 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.282794 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.282962 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.283095 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.283274 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.283408 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.283587 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.283733 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.283894 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.284036 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.284208 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.284341 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.284519 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.284655 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.284835 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.284970 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.285146 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.285283 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.285457 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.285595 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.285783 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.285985 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.286120 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.286316 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.286461 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.286656 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.286794 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.286971 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.287115 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.287284 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.287446 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.287602 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.287745 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.287913 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.288050 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.288225 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.288369 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.288641 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.288774 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.288911 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.289045 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.289190 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.289330 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.289462 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.289600 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.289739 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.289871 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.290056 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.290194 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.290374 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.290518 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.290713 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.290880 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.291148 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.291268 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.291380 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.291514 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.291644 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.291785 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.291926 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.292072 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.292207 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.292347 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.292524 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.292685 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.292821 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.292963 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.293131 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.293278 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.293423 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.293557 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.293736 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.293873 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.294043 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.294189 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.294353 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.294489 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.294700 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.294837 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.295014 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.295151 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.295326 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.295463 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.295638 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.295843 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.296655 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.296855 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.296999 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.297210 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.297356 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.297539 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.297684 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.297856 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.298015 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.298230 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.298363 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.298567 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.298689 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.298930 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.299096 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.299250 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.299403 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.299563 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.299732 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.299879 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.300059 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.300195 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.300469 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.300606 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.300789 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.300934 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.301216 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.301357 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.301499 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.301633 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.301848 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.301984 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.301984 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.302239 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.302384 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.302517 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.302690 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.302824 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.303020 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.303154 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.303285 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.303429 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.303571 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.303761 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.303906 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.304081 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.304231 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.304402 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.304547 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.304729 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.304926 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.305071 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.305278 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.305425 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.305594 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.305739 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.305922 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.306056 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.306249 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.306399 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.306588 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.306737 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.306871 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.307009 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.307191 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.307342 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.307499 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.307634 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.307804 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.307941 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.308120 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.308258 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.308431 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.308574 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.308854 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.308994 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.309136 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.309268 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.309399 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.309537 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.309678 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.309810 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.309951 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.310090 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.310222 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.310405 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.310562 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.310764 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.310918 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.311068 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.311918 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.312074 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.312209 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.312355 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.312487 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.312618 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.312755 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.312893 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.313024 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.313169 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.313301 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.313430 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.313559 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.313687 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.313817 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.313960 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.314089 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.314232 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.314362 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.314491 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.314639 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.314788 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.314919 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.315055 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.315186 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.315322 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.315466 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.315617 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.315750 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.315886 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.316024 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.316161 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.316302 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.316441 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.316578 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.316716 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.316846 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.316982 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.317126 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.317261 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.317437 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.317580 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.317762 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.317903 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.318074 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.318208 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.318387 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.318563 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.318759 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.319065 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.319065 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.319332 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.319465 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.319603 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.319735 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.319915 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.320087 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.320228 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.320360 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.320553 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.320698 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.320884 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.321021 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.321188 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.321329 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.321471 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.321622 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.321766 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.322039 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.322211 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.322343 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.322481 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.322649 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.322795 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.322933 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.323070 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.323214 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.323388 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.323528 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.323662 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.323799 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.323937 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.324069 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.324207 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.324348 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.324479 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.324611 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.324769 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.324905 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.325079 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.325223 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.325388 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.325532 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.325696 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.325833 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.326005 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.326149 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.326317 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.326462 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.326679 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.326818 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.327511 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.327654 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.327996 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.328152 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.328342 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.328487 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.328667 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.328814 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.329076 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.329210 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.329350 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.329496 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.329628 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.329766 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.329898 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.330042 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.330174 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.330318 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.330507 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.330666 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.330848 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.330986 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.331154 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.331373 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.331515 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.331646 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.331824 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.331977 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.332246 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.332383 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.332516 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.332647 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.332778 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.332909 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.333055 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.333194 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.333365 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.333502 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.333798 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.334193 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.334386 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.334598 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.334735 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.334866 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.335045 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.335173 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.335383 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.335521 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.335714 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.335854 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.336043 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.336188 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.336357 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.336490 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.336664 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.336801 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.336970 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.337120 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.337283 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.337426 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.337600 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.337744 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.337910 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.338055 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.338214 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.338349 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.338517 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.338663 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.338846 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.338983 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.339262 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.339395 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.339526 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.339667 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.339817 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.339957 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.340090 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.340221 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.340344 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.340481 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.340628 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.340760 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.340930 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.341072 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.341204 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.341345 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.341478 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.341657 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.341801 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.341975 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.342112 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.342388 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.342562 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.343312 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.343440 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.343571 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.343738 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.343921 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.344059 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.344206 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.344340 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.344470 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.344617 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.344749 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.344880 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.345046 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.345182 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.345436 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.345591 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.345733 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.345865 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.346004 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.346137 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.346321 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.346467 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.346668 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.346806 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.347058 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.347199 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.347383 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.347529 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.347699 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.347842 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.348009 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.348143 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.348343 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.348479 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.348657 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.348794 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.349052 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.349373 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.349373 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.349647 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.349779 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.349910 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.350040 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.350182 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.350325 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.350448 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.350607 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.350740 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.350885 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.351029 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.351197 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.351335 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.351510 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.351647 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.351815 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.351962 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.352131 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.352280 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.352572 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.352705 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.352835 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.352976 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.353116 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.353297 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.353426 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.353615 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.353737 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.353944 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.354068 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.354272 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.354417 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.354618 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.354775 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.354931 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.355076 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.355245 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.355389 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.355554 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.355698 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.355864 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.356007 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.356180 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.356330 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.356494 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.356642 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.356802 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.356939 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.357110 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.357247 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.357424 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.357562 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.357735 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.357872 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.358040 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.358187 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.358435 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.358685 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.358835 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.358967 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.359106 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.359254 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.359532 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124670) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 23 11:43:19.359678 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.359678 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.359990 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.360307 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.360613 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.360920 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.361229 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.361535 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.361865 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.362158 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.362477 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.362812 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.363134 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.363445 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.363762 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.364118 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.364450 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.364766 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.365073 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.365396 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.365715 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.366042 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.366358 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.366699 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.367052 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.367373 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.367916 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.368259 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.368587 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.368925 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.369261 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.369576 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.369884 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.370195 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.370525 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.370873 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.371191 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.371507 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.371824 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.372139 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.372453 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.372766 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.373078 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.373390 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.373701 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.374197 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.374695 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.375023 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.375354 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.375704 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.376034 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.376360 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.376683 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.377007 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.377323 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.377639 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.377952 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.378264 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.378616 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.378953 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.379273 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.379584 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.380093 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.380412 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.380736 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.381061 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.381377 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.381704 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.382031 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.382348 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.382715 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.383015 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.383348 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.383690 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.384024 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.384353 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.384673 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.384981 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.385290 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.385605 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.385926 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.386239 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.386563 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.386876 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.387189 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.387496 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.387802 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.388113 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.388423 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.388734 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.389040 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.389344 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.390188 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.390501 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.390844 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.391153 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.391468 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.391775 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.392082 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.392387 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.392698 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.393010 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.393347 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.393687 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.394008 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.394337 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.394684 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.395022 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.395337 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.395664 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.395992 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.396312 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.396628 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.396968 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.397284 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.397600 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.397917 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.398235 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.398567 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.398888 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.399221 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.399550 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.399861 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.400192 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.400515 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.400836 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.401158 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.401468 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.401800 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.402113 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.402428 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.402776 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.403092 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.403405 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.403725 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.404045 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.404377 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.404707 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.405030 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.405966 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.406299 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.406674 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.406994 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.407438 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.407676 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.407995 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.408310 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.408618 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:43:19.408862 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124669) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 23 11:43:19.421939 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO dbcounter [None req-7a160690-bddc-4a09-9261-84831a85871e None None] Registered counter for database nova_api Jun 23 11:43:19.442228 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_db.sqlalchemy.engines [None req-7a160690-bddc-4a09-9261-84831a85871e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124670) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 11:43:19.448911 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writer thread running {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 11:43:19.472165 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO dbcounter [None req-eb73e303-f42b-4509-abc9-f0d9b8a9941a None None] Registered counter for database nova_api Jun 23 11:43:19.495372 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_db.sqlalchemy.engines [None req-eb73e303-f42b-4509-abc9-f0d9b8a9941a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124669) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 11:43:19.502029 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writer thread running {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 11:43:19.506382 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.context [None req-7a160690-bddc-4a09-9261-84831a85871e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),10257dc1-1bb0-429b-a4e0-3986d13353db(cell1) {{(pid=124670) load_cells /opt/stack/nova/nova/context.py:464}} Jun 23 11:43:19.510476 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-7a160690-bddc-4a09-9261-84831a85871e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:43:19.512098 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-7a160690-bddc-4a09-9261-84831a85871e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:43:19.512890 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-7a160690-bddc-4a09-9261-84831a85871e None None] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:43:19.515369 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-7a160690-bddc-4a09-9261-84831a85871e None None] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:43:19.517346 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO dbcounter [None req-7a160690-bddc-4a09-9261-84831a85871e None None] Registered counter for database nova_cell0 Jun 23 11:43:19.521309 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO dbcounter [None req-7a160690-bddc-4a09-9261-84831a85871e None None] Registered counter for database nova_cell1 Jun 23 11:43:19.528329 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_db.sqlalchemy.engines [None req-7a160690-bddc-4a09-9261-84831a85871e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124670) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 11:43:19.531059 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_db.sqlalchemy.engines [None req-7a160690-bddc-4a09-9261-84831a85871e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124670) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 11:43:19.536040 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writer thread running {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 11:43:19.538551 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writer thread running {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 11:43:19.559453 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.context [None req-eb73e303-f42b-4509-abc9-f0d9b8a9941a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),10257dc1-1bb0-429b-a4e0-3986d13353db(cell1) {{(pid=124669) load_cells /opt/stack/nova/nova/context.py:464}} Jun 23 11:43:19.563777 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-eb73e303-f42b-4509-abc9-f0d9b8a9941a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:43:19.565511 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-eb73e303-f42b-4509-abc9-f0d9b8a9941a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:43:19.571714 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-eb73e303-f42b-4509-abc9-f0d9b8a9941a None None] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:43:19.571714 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-eb73e303-f42b-4509-abc9-f0d9b8a9941a None None] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:43:19.571714 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO dbcounter [None req-eb73e303-f42b-4509-abc9-f0d9b8a9941a None None] Registered counter for database nova_cell0 Jun 23 11:43:19.574241 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO dbcounter [None req-eb73e303-f42b-4509-abc9-f0d9b8a9941a None None] Registered counter for database nova_cell1 Jun 23 11:43:19.582019 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_db.sqlalchemy.engines [None req-eb73e303-f42b-4509-abc9-f0d9b8a9941a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124669) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 11:43:19.583351 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_db.sqlalchemy.engines [None req-eb73e303-f42b-4509-abc9-f0d9b8a9941a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124669) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 11:43:19.590858 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writer thread running {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 11:43:19.591203 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writer thread running {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 11:43:19.688971 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO dbcounter [None req-7a160690-bddc-4a09-9261-84831a85871e None None] Registered counter for database nova_cell0 Jun 23 11:43:19.695652 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_db.sqlalchemy.engines [None req-7a160690-bddc-4a09-9261-84831a85871e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124670) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 11:43:19.701770 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writer thread running {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 11:43:19.739716 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO dbcounter [None req-eb73e303-f42b-4509-abc9-f0d9b8a9941a None None] Registered counter for database nova_cell0 Jun 23 11:43:19.746292 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_db.sqlalchemy.engines [None req-eb73e303-f42b-4509-abc9-f0d9b8a9941a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124669) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 11:43:19.751446 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writer thread running {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 11:43:20.021357 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: WARNING keystonemiddleware.auth_token [None req-7a160690-bddc-4a09-9261-84831a85871e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 11:43:20.028571 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: WARNING keystonemiddleware.auth_token [None req-7a160690-bddc-4a09-9261-84831a85871e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 11:43:20.075148 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: WARNING keystonemiddleware.auth_token [None req-eb73e303-f42b-4509-abc9-f0d9b8a9941a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 11:43:20.083469 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: WARNING keystonemiddleware.auth_token [None req-eb73e303-f42b-4509-abc9-f0d9b8a9941a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 11:43:20.375781 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: WARNING keystonemiddleware.auth_token [None req-7a160690-bddc-4a09-9261-84831a85871e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 11:43:20.382564 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: WARNING keystonemiddleware.auth_token [None req-7a160690-bddc-4a09-9261-84831a85871e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 11:43:20.388079 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56471e0c89c0 pid: 124670 (default app) Jun 23 11:43:20.427089 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: WARNING keystonemiddleware.auth_token [None req-eb73e303-f42b-4509-abc9-f0d9b8a9941a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 11:43:20.433056 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: WARNING keystonemiddleware.auth_token [None req-eb73e303-f42b-4509-abc9-f0d9b8a9941a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 11:43:20.438927 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56471e0c89c0 pid: 124669 (default app) Jun 23 11:44:00.882441 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_api:SELECT=3 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:00.883591 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_cell0:SELECT=3 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:00.884310 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_cell1:SELECT=3 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:00.885421 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_cell0:SELECT=3 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:01.267080 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_api:SELECT=3 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:01.271786 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_cell1:SELECT=3 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:01.274173 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_cell0:SELECT=3 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:01.276741 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_cell0:SELECT=3 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:02.111773 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-e17d1e08-5127-4d97-b59d-747a5764f694 tempest-VolumesGetTestJSON-773606623 tempest-VolumesGetTestJSON-773606623-project] Action: 'create', calling method: .version_select at 0x7f5d08652700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-811984027", "metadata": {"Type": "work"}}} {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:44:03.056670 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-83da1f43-c738-4585-abb9-f0dcbe528b0d tempest-VolumesSnapshotsTestJSON-437706555 tempest-VolumesSnapshotsTestJSON-437706555-project] Action: 'create', calling method: .version_select at 0x7f5d08652700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-182916943"}} {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:44:04.328443 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-e17d1e08-5127-4d97-b59d-747a5764f694 tempest-VolumesGetTestJSON-773606623 tempest-VolumesGetTestJSON-773606623-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.453025 Jun 23 11:44:04.330294 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 1/1] 10.222.0.13 () {60 vars in 1155 bytes} [Thu Jun 23 11:44:00 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3459 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 23 11:44:04.347988 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-1ca97e49-1069-4d18-8cea-c586d537cb56 tempest-VolumesGetTestJSON-773606623 tempest-VolumesGetTestJSON-773606623-project] Calling method '.version_select at 0x7f5d08518550>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:04.882123 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-1ca97e49-1069-4d18-8cea-c586d537cb56 tempest-VolumesGetTestJSON-773606623 tempest-VolumesGetTestJSON-773606623-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/c3921dd3-d59a-4505-9fb4-176ffbf99ec2" status: 200 len: 352 microversion: 2.1 time: 0.543748 Jun 23 11:44:04.891504 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 2/2] 10.222.0.13 () {58 vars in 1244 bytes} [Thu Jun 23 11:44:04 2022] GET /compute/v2.1/os-volumes/c3921dd3-d59a-4505-9fb4-176ffbf99ec2 => generated 352 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:44:04.937881 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-83da1f43-c738-4585-abb9-f0dcbe528b0d tempest-VolumesSnapshotsTestJSON-437706555 tempest-VolumesSnapshotsTestJSON-437706555-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.681845 Jun 23 11:44:04.939354 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 1/3] 10.222.0.13 () {60 vars in 1154 bytes} [Thu Jun 23 11:44:01 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3685 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 23 11:44:04.951220 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-5c347f14-3566-480c-b26c-11faf09596f0 tempest-VolumesSnapshotsTestJSON-437706555 tempest-VolumesSnapshotsTestJSON-437706555-project] Calling method '.version_select at 0x7f5d085188b0>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:05.014165 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-5c347f14-3566-480c-b26c-11faf09596f0 tempest-VolumesSnapshotsTestJSON-437706555 tempest-VolumesSnapshotsTestJSON-437706555-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/0ccbdec9-f2e6-4829-a236-2883c424085f" status: 200 len: 344 microversion: 2.1 time: 0.061177 Jun 23 11:44:05.014165 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 3/4] 10.222.0.13 () {58 vars in 1244 bytes} [Thu Jun 23 11:44:04 2022] GET /compute/v2.1/os-volumes/0ccbdec9-f2e6-4829-a236-2883c424085f => generated 344 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:44:05.896966 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-a942152b-a115-422e-bc37-2e1c42020f2b tempest-VolumesGetTestJSON-773606623 tempest-VolumesGetTestJSON-773606623-project] Calling method '.version_select at 0x7f5d08516550>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:05.990834 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-a942152b-a115-422e-bc37-2e1c42020f2b tempest-VolumesGetTestJSON-773606623 tempest-VolumesGetTestJSON-773606623-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/c3921dd3-d59a-4505-9fb4-176ffbf99ec2" status: 200 len: 353 microversion: 2.1 time: 0.098056 Jun 23 11:44:05.991843 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 2/5] 10.222.0.13 () {58 vars in 1244 bytes} [Thu Jun 23 11:44:05 2022] GET /compute/v2.1/os-volumes/c3921dd3-d59a-4505-9fb4-176ffbf99ec2 => generated 353 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:44:06.005458 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-02bf9971-317f-4374-a19e-ec3936fc46c7 tempest-VolumesGetTestJSON-773606623 tempest-VolumesGetTestJSON-773606623-project] Calling method '.version_select at 0x7f5d08518d30>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:06.274664 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-65421f4d-e156-445e-bdf3-2d116c18236e tempest-VolumesSnapshotsTestJSON-437706555 tempest-VolumesSnapshotsTestJSON-437706555-project] Calling method '.version_select at 0x7f5d08516820>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:06.350402 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-02bf9971-317f-4374-a19e-ec3936fc46c7 tempest-VolumesGetTestJSON-773606623 tempest-VolumesGetTestJSON-773606623-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/c3921dd3-d59a-4505-9fb4-176ffbf99ec2" status: 200 len: 353 microversion: 2.1 time: 0.105121 Jun 23 11:44:06.350402 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 4/6] 10.222.0.13 () {58 vars in 1244 bytes} [Thu Jun 23 11:44:05 2022] GET /compute/v2.1/os-volumes/c3921dd3-d59a-4505-9fb4-176ffbf99ec2 => generated 353 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:44:06.350402 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-23e07fb3-7e41-4762-b38a-dc57e0832b9b tempest-VolumesGetTestJSON-773606623 tempest-VolumesGetTestJSON-773606623-project] Calling method '.version_select at 0x7f5d08530430>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:06.352125 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-65421f4d-e156-445e-bdf3-2d116c18236e tempest-VolumesSnapshotsTestJSON-437706555 tempest-VolumesSnapshotsTestJSON-437706555-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/0ccbdec9-f2e6-4829-a236-2883c424085f" status: 200 len: 345 microversion: 2.1 time: 0.113476 Jun 23 11:44:06.352125 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 3/7] 10.222.0.13 () {58 vars in 1244 bytes} [Thu Jun 23 11:44:06 2022] GET /compute/v2.1/os-volumes/0ccbdec9-f2e6-4829-a236-2883c424085f => generated 345 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:44:06.352125 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-8f13f7f6-886f-4a51-b0ea-08392c1ac5a2 tempest-VolumesSnapshotsTestJSON-437706555 tempest-VolumesSnapshotsTestJSON-437706555-project] Action: 'create', calling method: .version_select at 0x7f5d08516d30>, body: {"snapshot": {"volume_id": "0ccbdec9-f2e6-4829-a236-2883c424085f", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1833867591"}} {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:44:06.484384 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-23e07fb3-7e41-4762-b38a-dc57e0832b9b tempest-VolumesGetTestJSON-773606623 tempest-VolumesGetTestJSON-773606623-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/c3921dd3-d59a-4505-9fb4-176ffbf99ec2" status: 202 len: 0 microversion: 2.1 time: 0.367065 Jun 23 11:44:06.485285 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 5/8] 10.222.0.13 () {58 vars in 1247 bytes} [Thu Jun 23 11:44:06 2022] DELETE /compute/v2.1/os-volumes/c3921dd3-d59a-4505-9fb4-176ffbf99ec2 => generated 0 bytes in 371 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 23 11:44:06.510281 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-468956c9-e018-48ac-ab07-e598740a5007 tempest-VolumesGetTestJSON-773606623 tempest-VolumesGetTestJSON-773606623-project] Calling method '.version_select at 0x7f5d08518d30>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:06.819566 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-468956c9-e018-48ac-ab07-e598740a5007 tempest-VolumesGetTestJSON-773606623 tempest-VolumesGetTestJSON-773606623-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/c3921dd3-d59a-4505-9fb4-176ffbf99ec2" status: 200 len: 352 microversion: 2.1 time: 0.314694 Jun 23 11:44:06.827220 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 6/9] 10.222.0.13 () {58 vars in 1244 bytes} [Thu Jun 23 11:44:06 2022] GET /compute/v2.1/os-volumes/c3921dd3-d59a-4505-9fb4-176ffbf99ec2 => generated 352 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:44:06.994305 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-8f13f7f6-886f-4a51-b0ea-08392c1ac5a2 tempest-VolumesSnapshotsTestJSON-437706555 tempest-VolumesSnapshotsTestJSON-437706555-project] 10.222.0.13 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.854291 Jun 23 11:44:06.995987 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 4/10] 10.222.0.13 () {60 vars in 1161 bytes} [Thu Jun 23 11:44:06 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:44:07.013066 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-f78bead9-fc85-47d8-8e0a-25fe4878ae2a tempest-VolumesSnapshotsTestJSON-437706555 tempest-VolumesSnapshotsTestJSON-437706555-project] Calling method '.version_select at 0x7f5d085188b0>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:07.074173 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-f78bead9-fc85-47d8-8e0a-25fe4878ae2a tempest-VolumesSnapshotsTestJSON-437706555 tempest-VolumesSnapshotsTestJSON-437706555-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/de7ff860-b327-4b52-a694-ae30b733b2e2" status: 200 len: 287 microversion: 2.1 time: 0.070585 Jun 23 11:44:07.075318 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 7/11] 10.222.0.13 () {58 vars in 1250 bytes} [Thu Jun 23 11:44:07 2022] GET /compute/v2.1/os-snapshots/de7ff860-b327-4b52-a694-ae30b733b2e2 => generated 287 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:44:07.088144 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-feaff010-035a-42bb-9520-26cd8b7be0cf tempest-VolumesSnapshotsTestJSON-437706555 tempest-VolumesSnapshotsTestJSON-437706555-project] Calling method '.version_select at 0x7f5d08526940>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:07.209926 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-feaff010-035a-42bb-9520-26cd8b7be0cf tempest-VolumesSnapshotsTestJSON-437706555 tempest-VolumesSnapshotsTestJSON-437706555-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.126230 Jun 23 11:44:07.210922 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 5/12] 10.222.0.13 () {58 vars in 1139 bytes} [Thu Jun 23 11:44:07 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:44:07.227413 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-f324b241-7368-4fe7-80a5-f9143da9f501 tempest-VolumesSnapshotsTestJSON-437706555 tempest-VolumesSnapshotsTestJSON-437706555-project] Calling method '.version_select at 0x7f5d085305e0>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:07.290578 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-f324b241-7368-4fe7-80a5-f9143da9f501 tempest-VolumesSnapshotsTestJSON-437706555 tempest-VolumesSnapshotsTestJSON-437706555-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/de7ff860-b327-4b52-a694-ae30b733b2e2" status: 200 len: 287 microversion: 2.1 time: 0.071873 Jun 23 11:44:07.291150 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 8/13] 10.222.0.13 () {58 vars in 1250 bytes} [Thu Jun 23 11:44:07 2022] GET /compute/v2.1/os-snapshots/de7ff860-b327-4b52-a694-ae30b733b2e2 => generated 287 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:44:07.834517 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-4b004ef1-f4b1-4a30-9990-9cbe99045cfd tempest-VolumesGetTestJSON-773606623 tempest-VolumesGetTestJSON-773606623-project] Calling method '.version_select at 0x7f5d08526700>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:08.187880 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.wsgi [None req-4b004ef1-f4b1-4a30-9990-9cbe99045cfd tempest-VolumesGetTestJSON-773606623 tempest-VolumesGetTestJSON-773606623-project] HTTP exception thrown: Volume c3921dd3-d59a-4505-9fb4-176ffbf99ec2 could not be found. Jun 23 11:44:08.195232 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-4b004ef1-f4b1-4a30-9990-9cbe99045cfd tempest-VolumesGetTestJSON-773606623 tempest-VolumesGetTestJSON-773606623-project] Request method failure captured: Jun 23 11:44:08.195232 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: request: GET /compute/v2.1/os-volumes/c3921dd3-d59a-4505-9fb4-176ffbf99ec2 HTTP/1.1 Jun 23 11:44:08.195232 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Accept: application/json Jun 23 11:44:08.195232 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Accept-Encoding: identity Jun 23 11:44:08.195232 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Connection: close Jun 23 11:44:08.195232 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Content-Length: 0 Jun 23 11:44:08.195232 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Content-Type: application/json Jun 23 11:44:08.195232 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Host: 10.222.0.13 Jun 23 11:44:08.195232 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Openstack-System-Scope: None Jun 23 11:44:08.195232 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: User-Agent: python-urllib3/1.26.9 Jun 23 11:44:08.195232 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Auth-Token: gAAAAABitFIAAQb3GqYS1R83FtHrZ3cRE0WaQ2j3nh7l3Wk5nqYMvci_VOKplETerQTv-uN4ueSRx8dHDj-rQw29pFzUDPoMPm8kRBVNFcGbHPbWzzg-CiAIzx-H5pCK2AeI5tbYI15oQoY1WEQg0IxUdMr8_xjdMknYLl3QcQnfi7R2Ey7UcGY Jun 23 11:44:08.195232 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Domain-Id: None Jun 23 11:44:08.195232 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Domain-Name: None Jun 23 11:44:08.195232 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Identity-Status: Confirmed Jun 23 11:44:08.195232 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Is-Admin-Project: True Jun 23 11:44:08.195232 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Domain-Id: default Jun 23 11:44:08.195232 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Domain-Name: Default Jun 23 11:44:08.195232 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Id: 0252f30c9ada49a081547315cb6dcc22 Jun 23 11:44:08.195232 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Name: tempest-VolumesGetTestJSON-773606623 Jun 23 11:44:08.195232 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Role: member,reader Jun 23 11:44:08.195232 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Roles: member,reader Jun 23 11:44:08.196535 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_0252f30c9ada49a081547315cb6dcc22"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0252f30c9ada49a081547315cb6dcc22"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/0252f30c9ada49a081547315cb6dcc22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0252f30c9ada49a081547315cb6dcc22"}]}] Jun 23 11:44:08.196535 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant: tempest-VolumesGetTestJSON-773606623 Jun 23 11:44:08.196535 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant-Id: 0252f30c9ada49a081547315cb6dcc22 Jun 23 11:44:08.196535 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant-Name: tempest-VolumesGetTestJSON-773606623 Jun 23 11:44:08.196535 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User: tempest-VolumesGetTestJSON-773606623-project Jun 23 11:44:08.196535 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Domain-Id: default Jun 23 11:44:08.196535 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Domain-Name: Default Jun 23 11:44:08.196535 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Id: 40552f9345a34e86b8a0a791bef6b7bb Jun 23 11:44:08.196535 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Name: tempest-VolumesGetTestJSON-773606623-project Jun 23 11:44:08.196535 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: method: Jun 23 11:44:08.196535 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: exception: Volume c3921dd3-d59a-4505-9fb4-176ffbf99ec2 could not be found. Jun 23 11:44:08.196535 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: action_args: {'id': 'c3921dd3-d59a-4505-9fb4-176ffbf99ec2'} Jun 23 11:44:08.196535 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:44:08.197354 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:44:08.197354 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 11:44:08.197354 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 11:44:08.197354 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 11:44:08.197354 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 11:44:08.197354 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 11:44:08.197354 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 11:44:08.197354 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 11:44:08.197354 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 11:44:08.197354 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 11:44:08.197354 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 11:44:08.197354 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 11:44:08.197354 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 11:44:08.197354 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 11:44:08.197354 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 11:44:08.197354 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c3921dd3-d59a-4505-9fb4-176ffbf99ec2 could not be found. (HTTP 404) (Request-ID: req-a1acb360-e893-4aa7-b7be-67d01b2326cc) Jun 23 11:44:08.197354 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:44:08.197354 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:44:08.197354 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:44:08.198682 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:44:08.198682 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 23 11:44:08.198682 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 23 11:44:08.198682 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 11:44:08.198682 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 11:44:08.198682 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 23 11:44:08.198682 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 23 11:44:08.198682 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 11:44:08.198682 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 11:44:08.198682 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 11:44:08.198682 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 11:44:08.198682 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 11:44:08.198682 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 11:44:08.198682 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 11:44:08.198682 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 11:44:08.198682 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 11:44:08.198682 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 11:44:08.198682 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 11:44:08.198682 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 11:44:08.199730 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 11:44:08.199730 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 11:44:08.199730 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 11:44:08.199730 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 11:44:08.199730 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c3921dd3-d59a-4505-9fb4-176ffbf99ec2 could not be found. Jun 23 11:44:08.199730 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:44:08.199730 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:44:08.199730 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:44:08.199730 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:44:08.199730 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:44:08.199730 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:44:08.199730 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:44:08.199730 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:44:08.199730 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 11:44:08.199730 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 11:44:08.199730 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:44:08.199730 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:44:08.199730 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 23 11:44:08.199730 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:44:08.200786 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c3921dd3-d59a-4505-9fb4-176ffbf99ec2 could not be found. Jun 23 11:44:08.200786 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:44:08.200786 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:44:08.200786 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:44:08.200786 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:44:08.200786 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:44:08.200786 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:44:08.200786 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:44:08.200786 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:44:08.200786 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c3921dd3-d59a-4505-9fb4-176ffbf99ec2 could not be found. Jun 23 11:44:08.200786 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:44:08.204030 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-4b004ef1-f4b1-4a30-9990-9cbe99045cfd tempest-VolumesGetTestJSON-773606623 tempest-VolumesGetTestJSON-773606623-project] Returning 404 to user: Volume c3921dd3-d59a-4505-9fb4-176ffbf99ec2 could not be found. {{(pid=124669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:44:08.205050 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-4b004ef1-f4b1-4a30-9990-9cbe99045cfd tempest-VolumesGetTestJSON-773606623 tempest-VolumesGetTestJSON-773606623-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/c3921dd3-d59a-4505-9fb4-176ffbf99ec2" status: 404 len: 109 microversion: 2.1 time: 0.376107 Jun 23 11:44:08.227054 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 6/14] 10.222.0.13 () {58 vars in 1244 bytes} [Thu Jun 23 11:44:07 2022] GET /compute/v2.1/os-volumes/c3921dd3-d59a-4505-9fb4-176ffbf99ec2 => generated 109 bytes in 398 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:44:08.303000 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-cd332ca3-8f51-42b1-bd05-739d15008612 tempest-VolumesSnapshotsTestJSON-437706555 tempest-VolumesSnapshotsTestJSON-437706555-project] Calling method '.version_select at 0x7f5d085188b0>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:08.471419 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-cd332ca3-8f51-42b1-bd05-739d15008612 tempest-VolumesSnapshotsTestJSON-437706555 tempest-VolumesSnapshotsTestJSON-437706555-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/de7ff860-b327-4b52-a694-ae30b733b2e2" status: 200 len: 287 microversion: 2.1 time: 0.171532 Jun 23 11:44:08.471419 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 9/15] 10.222.0.13 () {58 vars in 1250 bytes} [Thu Jun 23 11:44:08 2022] GET /compute/v2.1/os-snapshots/de7ff860-b327-4b52-a694-ae30b733b2e2 => generated 287 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:44:09.485570 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-f25f9a4c-9ea5-45cd-8556-d0e7c92fa9af tempest-VolumesSnapshotsTestJSON-437706555 tempest-VolumesSnapshotsTestJSON-437706555-project] Calling method '.version_select at 0x7f5d08526d30>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:09.535470 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-f25f9a4c-9ea5-45cd-8556-d0e7c92fa9af tempest-VolumesSnapshotsTestJSON-437706555 tempest-VolumesSnapshotsTestJSON-437706555-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/de7ff860-b327-4b52-a694-ae30b733b2e2" status: 200 len: 287 microversion: 2.1 time: 0.057952 Jun 23 11:44:09.540118 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 7/16] 10.222.0.13 () {58 vars in 1250 bytes} [Thu Jun 23 11:44:09 2022] GET /compute/v2.1/os-snapshots/de7ff860-b327-4b52-a694-ae30b733b2e2 => generated 287 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:44:10.547354 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-efba5671-5e36-4dae-9644-92cbcc0fa7e4 tempest-VolumesSnapshotsTestJSON-437706555 tempest-VolumesSnapshotsTestJSON-437706555-project] Calling method '.version_select at 0x7f5d08516b80>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:10.615804 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-efba5671-5e36-4dae-9644-92cbcc0fa7e4 tempest-VolumesSnapshotsTestJSON-437706555 tempest-VolumesSnapshotsTestJSON-437706555-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/de7ff860-b327-4b52-a694-ae30b733b2e2" status: 200 len: 287 microversion: 2.1 time: 0.072949 Jun 23 11:44:10.616376 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 8/17] 10.222.0.13 () {58 vars in 1250 bytes} [Thu Jun 23 11:44:10 2022] GET /compute/v2.1/os-snapshots/de7ff860-b327-4b52-a694-ae30b733b2e2 => generated 287 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:44:10.696160 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-e43b9aab-e1d0-4c0e-84e3-35bc94d6dba9 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Action: 'create', calling method: .version_select at 0x7f5d08518ca0>, body: {"keypair": {"name": "tempest-keypair-1694173493", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqIcP575VV0YShJGAyeUr2K0CEMoHItw/5hKYQT4P+NrivImD7T94sXUVJk+Vb/fVn3bCQ37B+4AAKn3ZoRVeX0JDJiKoQAL+N2lbLsTzzPHzqDfVsEV7zWuA2Qk90M+w=="}} {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:44:10.761237 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.quota [None req-e43b9aab-e1d0-4c0e-84e3-35bc94d6dba9 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Getting quotas for project ee135767dfc846469d64b658372994a8. Resources: {'key_pairs'} {{(pid=124670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:44:10.773724 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.quota [None req-e43b9aab-e1d0-4c0e-84e3-35bc94d6dba9 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Getting quotas for user b7fd8323d29d445f903e2103453e8ae6 and project ee135767dfc846469d64b658372994a8. Resources: {'key_pairs'} {{(pid=124670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:44:10.946486 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-e43b9aab-e1d0-4c0e-84e3-35bc94d6dba9 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.499669 Jun 23 11:44:10.948505 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 10/18] 10.222.0.13 () {60 vars in 1158 bytes} [Thu Jun 23 11:44:10 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:44:11.627461 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-fb62c262-5c7e-4472-893d-1cb89e9ab2ee tempest-VolumesSnapshotsTestJSON-437706555 tempest-VolumesSnapshotsTestJSON-437706555-project] Calling method '.version_select at 0x7f5d0852e550>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:11.677547 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-fb62c262-5c7e-4472-893d-1cb89e9ab2ee tempest-VolumesSnapshotsTestJSON-437706555 tempest-VolumesSnapshotsTestJSON-437706555-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/de7ff860-b327-4b52-a694-ae30b733b2e2" status: 200 len: 287 microversion: 2.1 time: 0.053905 Jun 23 11:44:11.678194 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 9/19] 10.222.0.13 () {58 vars in 1250 bytes} [Thu Jun 23 11:44:11 2022] GET /compute/v2.1/os-snapshots/de7ff860-b327-4b52-a694-ae30b733b2e2 => generated 287 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:44:12.691729 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-d66f118f-9c26-4524-a64e-59d15f2b7272 tempest-VolumesSnapshotsTestJSON-437706555 tempest-VolumesSnapshotsTestJSON-437706555-project] Calling method '.version_select at 0x7f5d0848cca0>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:12.766208 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-d66f118f-9c26-4524-a64e-59d15f2b7272 tempest-VolumesSnapshotsTestJSON-437706555 tempest-VolumesSnapshotsTestJSON-437706555-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/de7ff860-b327-4b52-a694-ae30b733b2e2" status: 200 len: 287 microversion: 2.1 time: 0.080778 Jun 23 11:44:12.770793 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 11/20] 10.222.0.13 () {58 vars in 1250 bytes} [Thu Jun 23 11:44:12 2022] GET /compute/v2.1/os-snapshots/de7ff860-b327-4b52-a694-ae30b733b2e2 => generated 287 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:44:13.785926 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-a1a7adec-1191-4354-8236-a71063ce1a57 tempest-VolumesSnapshotsTestJSON-437706555 tempest-VolumesSnapshotsTestJSON-437706555-project] Calling method '.version_select at 0x7f5d0852eb80>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:13.995943 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-a1a7adec-1191-4354-8236-a71063ce1a57 tempest-VolumesSnapshotsTestJSON-437706555 tempest-VolumesSnapshotsTestJSON-437706555-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/de7ff860-b327-4b52-a694-ae30b733b2e2" status: 200 len: 288 microversion: 2.1 time: 0.221098 Jun 23 11:44:14.004661 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 10/21] 10.222.0.13 () {58 vars in 1250 bytes} [Thu Jun 23 11:44:13 2022] GET /compute/v2.1/os-snapshots/de7ff860-b327-4b52-a694-ae30b733b2e2 => generated 288 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:44:14.009306 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-0e859be5-901b-48c7-9bf7-9e9fe1850f80 tempest-VolumesSnapshotsTestJSON-437706555 tempest-VolumesSnapshotsTestJSON-437706555-project] Calling method '.version_select at 0x7f5d0848cdc0>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:14.347300 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-0e859be5-901b-48c7-9bf7-9e9fe1850f80 tempest-VolumesSnapshotsTestJSON-437706555 tempest-VolumesSnapshotsTestJSON-437706555-project] 10.222.0.13 "DELETE /compute/v2.1/os-snapshots/de7ff860-b327-4b52-a694-ae30b733b2e2" status: 202 len: 0 microversion: 2.1 time: 0.339880 Jun 23 11:44:14.347300 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 12/22] 10.222.0.13 () {58 vars in 1253 bytes} [Thu Jun 23 11:44:14 2022] DELETE /compute/v2.1/os-snapshots/de7ff860-b327-4b52-a694-ae30b733b2e2 => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 11:44:14.356254 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-9d38f0be-85b0-41b9-8f2e-8525ee1ef5bd tempest-VolumesSnapshotsTestJSON-437706555 tempest-VolumesSnapshotsTestJSON-437706555-project] Calling method '.version_select at 0x7f5d0852e820>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:14.461463 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-9d38f0be-85b0-41b9-8f2e-8525ee1ef5bd tempest-VolumesSnapshotsTestJSON-437706555 tempest-VolumesSnapshotsTestJSON-437706555-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/de7ff860-b327-4b52-a694-ae30b733b2e2" status: 200 len: 287 microversion: 2.1 time: 0.111479 Jun 23 11:44:14.470142 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 11/23] 10.222.0.13 () {58 vars in 1250 bytes} [Thu Jun 23 11:44:14 2022] GET /compute/v2.1/os-snapshots/de7ff860-b327-4b52-a694-ae30b733b2e2 => generated 287 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:44:15.230310 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-07e3285e-2657-496a-b561-d9962c64f8b8 tempest-VolumesTestJSON-2011332813 tempest-VolumesTestJSON-2011332813-project] Calling method '.version_select at 0x7f5d0848c4c0>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:15.359626 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-07e3285e-2657-496a-b561-d9962c64f8b8 tempest-VolumesTestJSON-2011332813 tempest-VolumesTestJSON-2011332813-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/e4b5a59a-ac85-463c-88a6-272436a67bd7" status: 200 len: 350 microversion: 2.1 time: 0.132992 Jun 23 11:44:15.360576 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 13/24] 10.222.0.13 () {58 vars in 1244 bytes} [Thu Jun 23 11:44:15 2022] GET /compute/v2.1/os-volumes/e4b5a59a-ac85-463c-88a6-272436a67bd7 => generated 350 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:44:15.474301 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-126975ee-a5c5-4e04-b95f-0e9a3257b934 tempest-VolumesSnapshotsTestJSON-437706555 tempest-VolumesSnapshotsTestJSON-437706555-project] Calling method '.version_select at 0x7f5d0852e160>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:15.616300 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.wsgi [None req-126975ee-a5c5-4e04-b95f-0e9a3257b934 tempest-VolumesSnapshotsTestJSON-437706555 tempest-VolumesSnapshotsTestJSON-437706555-project] HTTP exception thrown: Snapshot de7ff860-b327-4b52-a694-ae30b733b2e2 could not be found. Jun 23 11:44:15.617721 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-126975ee-a5c5-4e04-b95f-0e9a3257b934 tempest-VolumesSnapshotsTestJSON-437706555 tempest-VolumesSnapshotsTestJSON-437706555-project] Request method failure captured: Jun 23 11:44:15.617721 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: request: GET /compute/v2.1/os-snapshots/de7ff860-b327-4b52-a694-ae30b733b2e2 HTTP/1.1 Jun 23 11:44:15.617721 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Accept: application/json Jun 23 11:44:15.617721 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Accept-Encoding: identity Jun 23 11:44:15.617721 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Connection: close Jun 23 11:44:15.617721 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Content-Length: 0 Jun 23 11:44:15.617721 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Content-Type: application/json Jun 23 11:44:15.617721 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Host: 10.222.0.13 Jun 23 11:44:15.617721 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Openstack-System-Scope: None Jun 23 11:44:15.617721 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: User-Agent: python-urllib3/1.26.9 Jun 23 11:44:15.617721 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Auth-Token: gAAAAABitFIBSyXoUSWFXSe0sLUa3xzuXCLWpgMRHEYEhYNAAkyJL4rqFNNcQ2IdYfaJFiotz4-F02p86W69w2QXTXoosuL4909wOQcIrCw5AxLms_FEaVhT35GnzqECKHd8kHcFt8p0hMsFMr0BOvjlmHHZ3hwbW2STDSzisQMjXofoit-z7KI Jun 23 11:44:15.617721 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Domain-Id: None Jun 23 11:44:15.617721 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Domain-Name: None Jun 23 11:44:15.617721 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Identity-Status: Confirmed Jun 23 11:44:15.617721 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Is-Admin-Project: True Jun 23 11:44:15.617721 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Domain-Id: default Jun 23 11:44:15.617721 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Domain-Name: Default Jun 23 11:44:15.617721 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Id: 4431791e3ce94f4cae4d648f1af2f186 Jun 23 11:44:15.617721 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-437706555 Jun 23 11:44:15.617721 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Role: member,reader Jun 23 11:44:15.617721 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Roles: member,reader Jun 23 11:44:15.618824 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4431791e3ce94f4cae4d648f1af2f186"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4431791e3ce94f4cae4d648f1af2f186"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4431791e3ce94f4cae4d648f1af2f186"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4431791e3ce94f4cae4d648f1af2f186"}]}] Jun 23 11:44:15.618824 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant: tempest-VolumesSnapshotsTestJSON-437706555 Jun 23 11:44:15.618824 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant-Id: 4431791e3ce94f4cae4d648f1af2f186 Jun 23 11:44:15.618824 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-437706555 Jun 23 11:44:15.618824 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User: tempest-VolumesSnapshotsTestJSON-437706555-project Jun 23 11:44:15.618824 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Domain-Id: default Jun 23 11:44:15.618824 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Domain-Name: Default Jun 23 11:44:15.618824 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Id: 72cb75b4931b42f6bd5f71fa0a99a15e Jun 23 11:44:15.618824 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Name: tempest-VolumesSnapshotsTestJSON-437706555-project Jun 23 11:44:15.618824 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: method: Jun 23 11:44:15.618824 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: exception: Snapshot de7ff860-b327-4b52-a694-ae30b733b2e2 could not be found. Jun 23 11:44:15.618824 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: action_args: {'id': 'de7ff860-b327-4b52-a694-ae30b733b2e2'} Jun 23 11:44:15.618824 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:44:15.619482 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:44:15.619482 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 23 11:44:15.619482 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 23 11:44:15.619482 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 23 11:44:15.619482 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 23 11:44:15.619482 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 23 11:44:15.619482 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 23 11:44:15.619482 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 11:44:15.619482 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 11:44:15.619482 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 11:44:15.619482 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 11:44:15.619482 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 11:44:15.619482 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 11:44:15.619482 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 11:44:15.619482 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 11:44:15.619482 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot de7ff860-b327-4b52-a694-ae30b733b2e2 could not be found. (HTTP 404) (Request-ID: req-1d154f0c-5c94-4525-abde-42d4fca2424b) Jun 23 11:44:15.619482 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:44:15.619482 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:44:15.620363 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:44:15.620363 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:44:15.620363 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 23 11:44:15.620363 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 23 11:44:15.620363 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 11:44:15.620363 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 11:44:15.620363 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 23 11:44:15.620363 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 23 11:44:15.620363 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 11:44:15.620363 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 11:44:15.620363 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 23 11:44:15.620363 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 23 11:44:15.620363 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 23 11:44:15.620363 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 23 11:44:15.620363 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 23 11:44:15.620363 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 23 11:44:15.620363 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 11:44:15.620363 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 11:44:15.620363 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 11:44:15.621268 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 11:44:15.621268 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 11:44:15.621268 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 11:44:15.621268 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 11:44:15.621268 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 11:44:15.621268 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot de7ff860-b327-4b52-a694-ae30b733b2e2 could not be found. Jun 23 11:44:15.621268 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:44:15.621268 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:44:15.621268 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:44:15.621268 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:44:15.621268 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:44:15.621268 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:44:15.621268 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:44:15.621268 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:44:15.621268 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 11:44:15.621268 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 11:44:15.621268 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:44:15.621268 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:44:15.621268 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 23 11:44:15.621268 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:44:15.622191 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot de7ff860-b327-4b52-a694-ae30b733b2e2 could not be found. Jun 23 11:44:15.622191 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:44:15.622191 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:44:15.622191 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:44:15.622191 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:44:15.622191 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:44:15.622191 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:44:15.622191 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:44:15.622191 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:44:15.622191 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot de7ff860-b327-4b52-a694-ae30b733b2e2 could not be found. Jun 23 11:44:15.622191 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:44:15.622191 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-126975ee-a5c5-4e04-b95f-0e9a3257b934 tempest-VolumesSnapshotsTestJSON-437706555 tempest-VolumesSnapshotsTestJSON-437706555-project] Returning 404 to user: Snapshot de7ff860-b327-4b52-a694-ae30b733b2e2 could not be found. {{(pid=124669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:44:15.622191 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-126975ee-a5c5-4e04-b95f-0e9a3257b934 tempest-VolumesSnapshotsTestJSON-437706555 tempest-VolumesSnapshotsTestJSON-437706555-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/de7ff860-b327-4b52-a694-ae30b733b2e2" status: 404 len: 111 microversion: 2.1 time: 0.149132 Jun 23 11:44:15.629994 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-25b16adc-86ce-4d6a-b941-97432ffa840e tempest-VolumesSnapshotsTestJSON-437706555 tempest-VolumesSnapshotsTestJSON-437706555-project] Calling method '.version_select at 0x7f5d07c3e670>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:15.633712 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 12/25] 10.222.0.13 () {58 vars in 1250 bytes} [Thu Jun 23 11:44:15 2022] GET /compute/v2.1/os-snapshots/de7ff860-b327-4b52-a694-ae30b733b2e2 => generated 111 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:44:15.965629 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-25b16adc-86ce-4d6a-b941-97432ffa840e tempest-VolumesSnapshotsTestJSON-437706555 tempest-VolumesSnapshotsTestJSON-437706555-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/0ccbdec9-f2e6-4829-a236-2883c424085f" status: 202 len: 0 microversion: 2.1 time: 0.340861 Jun 23 11:44:15.974953 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 14/26] 10.222.0.13 () {58 vars in 1247 bytes} [Thu Jun 23 11:44:15 2022] DELETE /compute/v2.1/os-volumes/0ccbdec9-f2e6-4829-a236-2883c424085f => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 11:44:15.976896 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-89a2a48c-5c83-4923-990c-bfc2e5f0a7e7 tempest-VolumesSnapshotsTestJSON-437706555 tempest-VolumesSnapshotsTestJSON-437706555-project] Calling method '.version_select at 0x7f5d08516a60>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:16.121365 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-89a2a48c-5c83-4923-990c-bfc2e5f0a7e7 tempest-VolumesSnapshotsTestJSON-437706555 tempest-VolumesSnapshotsTestJSON-437706555-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/0ccbdec9-f2e6-4829-a236-2883c424085f" status: 200 len: 344 microversion: 2.1 time: 0.147519 Jun 23 11:44:16.125224 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 13/27] 10.222.0.13 () {58 vars in 1244 bytes} [Thu Jun 23 11:44:15 2022] GET /compute/v2.1/os-volumes/0ccbdec9-f2e6-4829-a236-2883c424085f => generated 344 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:44:17.132800 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-a8214f12-8b35-4844-8b7a-231f5d39456c tempest-VolumesSnapshotsTestJSON-437706555 tempest-VolumesSnapshotsTestJSON-437706555-project] Calling method '.version_select at 0x7f5d0852e700>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:17.256906 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-a8214f12-8b35-4844-8b7a-231f5d39456c tempest-VolumesSnapshotsTestJSON-437706555 tempest-VolumesSnapshotsTestJSON-437706555-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/0ccbdec9-f2e6-4829-a236-2883c424085f" status: 200 len: 344 microversion: 2.1 time: 0.128092 Jun 23 11:44:17.257480 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 14/28] 10.222.0.13 () {58 vars in 1244 bytes} [Thu Jun 23 11:44:17 2022] GET /compute/v2.1/os-volumes/0ccbdec9-f2e6-4829-a236-2883c424085f => generated 344 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:44:17.515675 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-eb75c2e2-29b2-4c5b-9e71-fcd91748576c tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1681819861", "imageRef": "b19d6f23-214c-4432-bee6-455978023759", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:44:17.656686 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.network.neutron [None req-eb75c2e2-29b2-4c5b-9e71-fcd91748576c tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] validate_networks() for [('f1d4f6fa-8901-4f39-bc7b-fa92cecf023d', None, None, None, None, None)] {{(pid=124670) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 11:44:18.277642 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-ab2d47f9-320b-42e5-b4d2-3d179336f1b1 tempest-VolumesSnapshotsTestJSON-437706555 tempest-VolumesSnapshotsTestJSON-437706555-project] Calling method '.version_select at 0x7f5d08526af0>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:18.369321 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-ab2d47f9-320b-42e5-b4d2-3d179336f1b1 tempest-VolumesSnapshotsTestJSON-437706555 tempest-VolumesSnapshotsTestJSON-437706555-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/0ccbdec9-f2e6-4829-a236-2883c424085f" status: 200 len: 344 microversion: 2.1 time: 0.100906 Jun 23 11:44:18.370150 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 15/29] 10.222.0.13 () {58 vars in 1244 bytes} [Thu Jun 23 11:44:18 2022] GET /compute/v2.1/os-volumes/0ccbdec9-f2e6-4829-a236-2883c424085f => generated 344 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:44:18.685511 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.virt.hardware [None req-eb75c2e2-29b2-4c5b-9e71-fcd91748576c tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Flavor limits 0:0:0 {{(pid=124670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 11:44:18.686963 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.virt.hardware [None req-eb75c2e2-29b2-4c5b-9e71-fcd91748576c tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Image limits 0:0:0 {{(pid=124670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 11:44:18.687861 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.virt.hardware [None req-eb75c2e2-29b2-4c5b-9e71-fcd91748576c tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Flavor pref 0:0:0 {{(pid=124670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 11:44:18.688518 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.virt.hardware [None req-eb75c2e2-29b2-4c5b-9e71-fcd91748576c tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Image pref 0:0:0 {{(pid=124670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 11:44:18.689079 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.virt.hardware [None req-eb75c2e2-29b2-4c5b-9e71-fcd91748576c tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 11:44:18.709855 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-eb75c2e2-29b2-4c5b-9e71-fcd91748576c tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:18.709855 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-eb75c2e2-29b2-4c5b-9e71-fcd91748576c tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:18.710162 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-eb75c2e2-29b2-4c5b-9e71-fcd91748576c tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:18.711732 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-eb75c2e2-29b2-4c5b-9e71-fcd91748576c tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:18.745074 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.quota [None req-eb75c2e2-29b2-4c5b-9e71-fcd91748576c tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Getting quotas for project b6241924efa944a68503a87b695c7410. Resources: {'cores', 'instances', 'ram'} {{(pid=124670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:44:18.750753 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.quota [None req-eb75c2e2-29b2-4c5b-9e71-fcd91748576c tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Getting quotas for user bcd5fc6167654972868941ed28c327b6 and project b6241924efa944a68503a87b695c7410. Resources: {'cores', 'instances', 'ram'} {{(pid=124670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:44:18.775819 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-eb75c2e2-29b2-4c5b-9e71-fcd91748576c tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Going to run 1 instances... {{(pid=124670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 11:44:18.788707 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-eb75c2e2-29b2-4c5b-9e71-fcd91748576c tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 762e880e-7ec3-41bb-aac7-fa05de4efd11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b19d6f23-214c-4432-bee6-455978023759',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 11:44:18.975236 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-eb75c2e2-29b2-4c5b-9e71-fcd91748576c tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.083757 Jun 23 11:44:18.975887 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 15/30] 10.222.0.13 () {60 vars in 1146 bytes} [Thu Jun 23 11:44:16 2022] POST /compute/v2.1/servers => generated 383 bytes in 2085 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 11:44:18.986922 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-7d2cb1a1-4cc1-41d9-b32e-3038de2ca700 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:18.988115 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-7d2cb1a1-4cc1-41d9-b32e-3038de2ca700 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 762e880e-7ec3-41bb-aac7-fa05de4efd11] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:19.134571 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-7d2cb1a1-4cc1-41d9-b32e-3038de2ca700 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:19.173364 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-7d2cb1a1-4cc1-41d9-b32e-3038de2ca700 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/762e880e-7ec3-41bb-aac7-fa05de4efd11" status: 200 len: 1222 microversion: 2.1 time: 0.182772 Jun 23 11:44:19.175536 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 16/31] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:18 2022] GET /compute/v2.1/servers/762e880e-7ec3-41bb-aac7-fa05de4efd11 => generated 1222 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:44:19.395776 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-791b8591-7ec4-40f2-adb7-5f85f57222f2 tempest-VolumesSnapshotsTestJSON-437706555 tempest-VolumesSnapshotsTestJSON-437706555-project] Calling method '.version_select at 0x7f5d07be4700>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:19.511099 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-98067a26-2397-445d-a178-f015275306b8 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1671840479", "imageRef": "b19d6f23-214c-4432-bee6-455978023759", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:44:19.517907 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-791b8591-7ec4-40f2-adb7-5f85f57222f2 tempest-VolumesSnapshotsTestJSON-437706555 tempest-VolumesSnapshotsTestJSON-437706555-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/0ccbdec9-f2e6-4829-a236-2883c424085f" status: 200 len: 344 microversion: 2.1 time: 0.136449 Jun 23 11:44:19.518304 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 16/32] 10.222.0.13 () {58 vars in 1244 bytes} [Thu Jun 23 11:44:19 2022] GET /compute/v2.1/os-volumes/0ccbdec9-f2e6-4829-a236-2883c424085f => generated 344 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:44:19.740355 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.network.neutron [None req-98067a26-2397-445d-a178-f015275306b8 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] validate_networks() for [('f1d4f6fa-8901-4f39-bc7b-fa92cecf023d', None, None, None, None, None)] {{(pid=124669) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 11:44:20.009006 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-7e567656-c2b2-465c-b4f0-68a593596b21 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1404692268", "imageRef": "b19d6f23-214c-4432-bee6-455978023759", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1be91f97-511d-47dc-890a-297123afd9f6"}], "security_groups": [{"name": "tempest-securitygroup--1020641200"}], "key_name": "tempest-keypair-1694173493", "user_data": "}} {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:44:20.354325 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.network.neutron [None req-7e567656-c2b2-465c-b4f0-68a593596b21 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] validate_networks() for [('1be91f97-511d-47dc-890a-297123afd9f6', None, None, None, None, None)] {{(pid=124670) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 11:44:21.306160 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.virt.hardware [None req-7e567656-c2b2-465c-b4f0-68a593596b21 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Flavor limits 0:0:0 {{(pid=124670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 11:44:21.306814 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.virt.hardware [None req-7e567656-c2b2-465c-b4f0-68a593596b21 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Image limits 0:0:0 {{(pid=124670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 11:44:21.307384 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.virt.hardware [None req-7e567656-c2b2-465c-b4f0-68a593596b21 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Flavor pref 0:0:0 {{(pid=124670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 11:44:21.307907 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.virt.hardware [None req-7e567656-c2b2-465c-b4f0-68a593596b21 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Image pref 0:0:0 {{(pid=124670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 11:44:21.308826 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.virt.hardware [None req-7e567656-c2b2-465c-b4f0-68a593596b21 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 11:44:21.314840 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.virt.hardware [None req-98067a26-2397-445d-a178-f015275306b8 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Flavor limits 0:0:0 {{(pid=124669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 11:44:21.315426 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.virt.hardware [None req-98067a26-2397-445d-a178-f015275306b8 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Image limits 0:0:0 {{(pid=124669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 11:44:21.315733 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.virt.hardware [None req-98067a26-2397-445d-a178-f015275306b8 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Flavor pref 0:0:0 {{(pid=124669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 11:44:21.316138 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.virt.hardware [None req-98067a26-2397-445d-a178-f015275306b8 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Image pref 0:0:0 {{(pid=124669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 11:44:21.316550 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.virt.hardware [None req-98067a26-2397-445d-a178-f015275306b8 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 11:44:21.336842 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-98067a26-2397-445d-a178-f015275306b8 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:21.337887 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-98067a26-2397-445d-a178-f015275306b8 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:21.338896 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-98067a26-2397-445d-a178-f015275306b8 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:21.339540 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-98067a26-2397-445d-a178-f015275306b8 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:21.340928 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-7e567656-c2b2-465c-b4f0-68a593596b21 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:21.344141 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-7e567656-c2b2-465c-b4f0-68a593596b21 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:21.345012 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-7e567656-c2b2-465c-b4f0-68a593596b21 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:21.345455 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-7e567656-c2b2-465c-b4f0-68a593596b21 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:21.377806 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.quota [None req-98067a26-2397-445d-a178-f015275306b8 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Getting quotas for project b6241924efa944a68503a87b695c7410. Resources: {'cores', 'instances', 'ram'} {{(pid=124669) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:44:21.397593 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.quota [None req-98067a26-2397-445d-a178-f015275306b8 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Getting quotas for user bcd5fc6167654972868941ed28c327b6 and project b6241924efa944a68503a87b695c7410. Resources: {'cores', 'instances', 'ram'} {{(pid=124669) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:44:21.404966 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.quota [None req-7e567656-c2b2-465c-b4f0-68a593596b21 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Getting quotas for project ee135767dfc846469d64b658372994a8. Resources: {'cores', 'instances', 'ram'} {{(pid=124670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:44:21.416846 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.quota [None req-7e567656-c2b2-465c-b4f0-68a593596b21 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Getting quotas for user b7fd8323d29d445f903e2103453e8ae6 and project ee135767dfc846469d64b658372994a8. Resources: {'cores', 'instances', 'ram'} {{(pid=124670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:44:21.427003 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-98067a26-2397-445d-a178-f015275306b8 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Going to run 1 instances... {{(pid=124669) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 11:44:21.433380 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-98067a26-2397-445d-a178-f015275306b8 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 0953fa06-0916-418f-b527-06d088cc6066] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b19d6f23-214c-4432-bee6-455978023759',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124669) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 11:44:21.446389 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-7e567656-c2b2-465c-b4f0-68a593596b21 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Going to run 1 instances... {{(pid=124670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 11:44:21.448457 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-7e567656-c2b2-465c-b4f0-68a593596b21 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 250e2ce6-70ad-4082-8073-6a9cea0ca1e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b19d6f23-214c-4432-bee6-455978023759',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 11:44:21.742011 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-7e567656-c2b2-465c-b4f0-68a593596b21 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.738812 Jun 23 11:44:21.744228 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 17/33] 10.222.0.13 () {60 vars in 1146 bytes} [Thu Jun 23 11:44:20 2022] POST /compute/v2.1/servers => generated 402 bytes in 1742 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 23 11:44:21.782597 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-98067a26-2397-445d-a178-f015275306b8 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.279644 Jun 23 11:44:21.783595 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 17/34] 10.222.0.13 () {60 vars in 1146 bytes} [Thu Jun 23 11:44:19 2022] POST /compute/v2.1/servers => generated 383 bytes in 2282 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 23 11:44:21.799289 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-0213ef90-c108-42c6-aee6-2c9aed5e2cd1 tempest-VolumesSnapshotsTestJSON-437706555 tempest-VolumesSnapshotsTestJSON-437706555-project] Calling method '.version_select at 0x7f5d07b45670>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:21.910801 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.wsgi [None req-0213ef90-c108-42c6-aee6-2c9aed5e2cd1 tempest-VolumesSnapshotsTestJSON-437706555 tempest-VolumesSnapshotsTestJSON-437706555-project] HTTP exception thrown: Volume 0ccbdec9-f2e6-4829-a236-2883c424085f could not be found. Jun 23 11:44:21.913679 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-0213ef90-c108-42c6-aee6-2c9aed5e2cd1 tempest-VolumesSnapshotsTestJSON-437706555 tempest-VolumesSnapshotsTestJSON-437706555-project] Request method failure captured: Jun 23 11:44:21.913679 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: request: GET /compute/v2.1/os-volumes/0ccbdec9-f2e6-4829-a236-2883c424085f HTTP/1.1 Jun 23 11:44:21.913679 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Accept: application/json Jun 23 11:44:21.913679 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Accept-Encoding: identity Jun 23 11:44:21.913679 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Connection: close Jun 23 11:44:21.913679 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Content-Length: 0 Jun 23 11:44:21.913679 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Content-Type: application/json Jun 23 11:44:21.913679 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Host: 10.222.0.13 Jun 23 11:44:21.913679 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Openstack-System-Scope: None Jun 23 11:44:21.913679 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: User-Agent: python-urllib3/1.26.9 Jun 23 11:44:21.913679 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Auth-Token: gAAAAABitFIBSyXoUSWFXSe0sLUa3xzuXCLWpgMRHEYEhYNAAkyJL4rqFNNcQ2IdYfaJFiotz4-F02p86W69w2QXTXoosuL4909wOQcIrCw5AxLms_FEaVhT35GnzqECKHd8kHcFt8p0hMsFMr0BOvjlmHHZ3hwbW2STDSzisQMjXofoit-z7KI Jun 23 11:44:21.913679 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Domain-Id: None Jun 23 11:44:21.913679 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Domain-Name: None Jun 23 11:44:21.913679 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Identity-Status: Confirmed Jun 23 11:44:21.913679 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Is-Admin-Project: True Jun 23 11:44:21.913679 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Domain-Id: default Jun 23 11:44:21.913679 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Domain-Name: Default Jun 23 11:44:21.913679 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Id: 4431791e3ce94f4cae4d648f1af2f186 Jun 23 11:44:21.913679 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-437706555 Jun 23 11:44:21.913679 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Role: member,reader Jun 23 11:44:21.913679 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Roles: member,reader Jun 23 11:44:21.915063 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4431791e3ce94f4cae4d648f1af2f186"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4431791e3ce94f4cae4d648f1af2f186"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4431791e3ce94f4cae4d648f1af2f186"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4431791e3ce94f4cae4d648f1af2f186"}]}] Jun 23 11:44:21.915063 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant: tempest-VolumesSnapshotsTestJSON-437706555 Jun 23 11:44:21.915063 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant-Id: 4431791e3ce94f4cae4d648f1af2f186 Jun 23 11:44:21.915063 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-437706555 Jun 23 11:44:21.915063 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User: tempest-VolumesSnapshotsTestJSON-437706555-project Jun 23 11:44:21.915063 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Domain-Id: default Jun 23 11:44:21.915063 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Domain-Name: Default Jun 23 11:44:21.915063 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Id: 72cb75b4931b42f6bd5f71fa0a99a15e Jun 23 11:44:21.915063 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Name: tempest-VolumesSnapshotsTestJSON-437706555-project Jun 23 11:44:21.915063 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: method: Jun 23 11:44:21.915063 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: exception: Volume 0ccbdec9-f2e6-4829-a236-2883c424085f could not be found. Jun 23 11:44:21.915063 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: action_args: {'id': '0ccbdec9-f2e6-4829-a236-2883c424085f'} Jun 23 11:44:21.915063 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:44:21.915952 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:44:21.915952 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 11:44:21.915952 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 11:44:21.915952 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 11:44:21.915952 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 11:44:21.915952 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 11:44:21.915952 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 11:44:21.915952 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 11:44:21.915952 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 11:44:21.915952 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 11:44:21.915952 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 11:44:21.915952 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 11:44:21.915952 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 11:44:21.915952 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 11:44:21.915952 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 11:44:21.915952 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0ccbdec9-f2e6-4829-a236-2883c424085f could not be found. (HTTP 404) (Request-ID: req-73dc3d19-cf93-4807-b91b-78e62255e017) Jun 23 11:44:21.915952 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:44:21.915952 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:44:21.915952 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:44:21.917237 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:44:21.917237 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 23 11:44:21.917237 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 23 11:44:21.917237 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 11:44:21.917237 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 11:44:21.917237 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 23 11:44:21.917237 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 23 11:44:21.917237 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 11:44:21.917237 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 11:44:21.917237 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 11:44:21.917237 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 11:44:21.917237 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 11:44:21.917237 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 11:44:21.917237 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 11:44:21.917237 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 11:44:21.917237 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 11:44:21.917237 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 11:44:21.917237 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 11:44:21.917237 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 11:44:21.918633 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 11:44:21.918633 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 11:44:21.918633 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 11:44:21.918633 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 11:44:21.918633 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0ccbdec9-f2e6-4829-a236-2883c424085f could not be found. Jun 23 11:44:21.918633 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:44:21.918633 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:44:21.918633 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:44:21.918633 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:44:21.918633 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:44:21.918633 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:44:21.918633 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:44:21.918633 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:44:21.918633 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 11:44:21.918633 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 11:44:21.918633 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:44:21.918633 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:44:21.918633 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 23 11:44:21.918633 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:44:21.919888 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0ccbdec9-f2e6-4829-a236-2883c424085f could not be found. Jun 23 11:44:21.919888 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:44:21.919888 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:44:21.919888 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:44:21.919888 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:44:21.919888 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:44:21.919888 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:44:21.919888 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:44:21.919888 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:44:21.919888 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0ccbdec9-f2e6-4829-a236-2883c424085f could not be found. Jun 23 11:44:21.919888 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:44:21.922880 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-0213ef90-c108-42c6-aee6-2c9aed5e2cd1 tempest-VolumesSnapshotsTestJSON-437706555 tempest-VolumesSnapshotsTestJSON-437706555-project] Returning 404 to user: Volume 0ccbdec9-f2e6-4829-a236-2883c424085f could not be found. {{(pid=124669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:44:21.924013 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-0213ef90-c108-42c6-aee6-2c9aed5e2cd1 tempest-VolumesSnapshotsTestJSON-437706555 tempest-VolumesSnapshotsTestJSON-437706555-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/0ccbdec9-f2e6-4829-a236-2883c424085f" status: 404 len: 109 microversion: 2.1 time: 0.138782 Jun 23 11:44:21.924853 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 18/35] 10.222.0.13 () {58 vars in 1244 bytes} [Thu Jun 23 11:44:21 2022] GET /compute/v2.1/os-volumes/0ccbdec9-f2e6-4829-a236-2883c424085f => generated 109 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:44:21.929922 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-9bfe9350-2874-48dd-9b89-544c455d513d tempest-VolumesTestJSON-2011332813 tempest-VolumesTestJSON-2011332813-project] Calling method '.version_select at 0x7f5d07b58280>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:22.010458 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-9bfe9350-2874-48dd-9b89-544c455d513d tempest-VolumesTestJSON-2011332813 tempest-VolumesTestJSON-2011332813-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/f6f39c1a-9be9-4da9-ad90-86305b0c1400" status: 200 len: 350 microversion: 2.1 time: 0.084259 Jun 23 11:44:22.011272 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 19/36] 10.222.0.13 () {58 vars in 1244 bytes} [Thu Jun 23 11:44:21 2022] GET /compute/v2.1/os-volumes/f6f39c1a-9be9-4da9-ad90-86305b0c1400 => generated 350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:44:22.273507 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-932b9a68-df73-4129-9626-ab9134649bd3 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Action: 'create', calling method: .version_select at 0x7f5d06b70940>, body: {"keypair": {"name": "tempest-keypair-1124038880", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLMmesIkrSmrr5W8O8uBqdQli5AlSfo8xx3ZgVFNwi7rh/q3JI/x1nRAszVebVPdEfJXQOI5vC1MsegYGb6T/TD17peSuMa0FanMEXcbBk5WAFyZqM2Xmh6YCzGhnIFArA=="}} {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:44:22.310942 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.quota [None req-932b9a68-df73-4129-9626-ab9134649bd3 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Getting quotas for project 45db495ff8c04b55b44c80a3ab412fb9. Resources: {'key_pairs'} {{(pid=124670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:44:22.322295 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.quota [None req-932b9a68-df73-4129-9626-ab9134649bd3 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Getting quotas for user d1b988f3241a46308b7c3683e2943b78 and project 45db495ff8c04b55b44c80a3ab412fb9. Resources: {'key_pairs'} {{(pid=124670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:44:22.416198 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-103c1089-6375-4f2b-98c6-ed2004f660ee tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-741737904", "imageRef": "b19d6f23-214c-4432-bee6-455978023759", "flavorRef": "452", "networks": [{"uuid": "1e000128-3edc-43be-9d79-33781ecfc11d"}]}} {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:44:22.487389 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-932b9a68-df73-4129-9626-ab9134649bd3 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.732103 Jun 23 11:44:22.487389 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 18/37] 10.222.0.13 () {60 vars in 1158 bytes} [Thu Jun 23 11:44:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:44:22.493972 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-2f1842f9-ac23-424a-9e97-77ea9f9b3d0d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:22.494720 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-2f1842f9-ac23-424a-9e97-77ea9f9b3d0d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 250e2ce6-70ad-4082-8073-6a9cea0ca1e4] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:22.498497 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.network.neutron [None req-103c1089-6375-4f2b-98c6-ed2004f660ee tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] validate_networks() for [('1e000128-3edc-43be-9d79-33781ecfc11d', None, None, None, None, None)] {{(pid=124669) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 11:44:22.625968 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-2f1842f9-ac23-424a-9e97-77ea9f9b3d0d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:22.666373 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-2f1842f9-ac23-424a-9e97-77ea9f9b3d0d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4" status: 200 len: 1242 microversion: 2.1 time: 0.185720 Jun 23 11:44:22.668372 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 19/38] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:22 2022] GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4 => generated 1242 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:44:22.687422 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-f8879f45-79ba-4ba7-97ec-b053269abe8d tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:22.690608 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-f8879f45-79ba-4ba7-97ec-b053269abe8d tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 0953fa06-0916-418f-b527-06d088cc6066] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:23.069856 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-f8879f45-79ba-4ba7-97ec-b053269abe8d tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:23.077145 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-f8879f45-79ba-4ba7-97ec-b053269abe8d tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066" status: 200 len: 1222 microversion: 2.1 time: 0.403788 Jun 23 11:44:23.077726 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 20/39] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:22 2022] GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066 => generated 1222 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:44:23.083297 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-12e11087-fddc-488e-bae7-e63a5da678c7 tempest-VolumesSnapshotsTestJSON-437706555 tempest-VolumesSnapshotsTestJSON-437706555-project] Calling method '.version_select at 0x7f5d06ba44c0>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:23.142128 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.wsgi [None req-12e11087-fddc-488e-bae7-e63a5da678c7 tempest-VolumesSnapshotsTestJSON-437706555 tempest-VolumesSnapshotsTestJSON-437706555-project] HTTP exception thrown: Volume 0ccbdec9-f2e6-4829-a236-2883c424085f could not be found. Jun 23 11:44:23.146674 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-12e11087-fddc-488e-bae7-e63a5da678c7 tempest-VolumesSnapshotsTestJSON-437706555 tempest-VolumesSnapshotsTestJSON-437706555-project] Request method failure captured: Jun 23 11:44:23.146674 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: request: DELETE /compute/v2.1/os-volumes/0ccbdec9-f2e6-4829-a236-2883c424085f HTTP/1.1 Jun 23 11:44:23.146674 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Accept: application/json Jun 23 11:44:23.146674 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Accept-Encoding: identity Jun 23 11:44:23.146674 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Connection: close Jun 23 11:44:23.146674 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Content-Length: 0 Jun 23 11:44:23.146674 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Content-Type: application/json Jun 23 11:44:23.146674 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Host: 10.222.0.13 Jun 23 11:44:23.146674 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Openstack-System-Scope: None Jun 23 11:44:23.146674 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: User-Agent: python-urllib3/1.26.9 Jun 23 11:44:23.146674 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Auth-Token: gAAAAABitFIBSyXoUSWFXSe0sLUa3xzuXCLWpgMRHEYEhYNAAkyJL4rqFNNcQ2IdYfaJFiotz4-F02p86W69w2QXTXoosuL4909wOQcIrCw5AxLms_FEaVhT35GnzqECKHd8kHcFt8p0hMsFMr0BOvjlmHHZ3hwbW2STDSzisQMjXofoit-z7KI Jun 23 11:44:23.146674 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Domain-Id: None Jun 23 11:44:23.146674 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Domain-Name: None Jun 23 11:44:23.146674 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Identity-Status: Confirmed Jun 23 11:44:23.146674 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Is-Admin-Project: True Jun 23 11:44:23.146674 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Domain-Id: default Jun 23 11:44:23.146674 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Domain-Name: Default Jun 23 11:44:23.146674 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Id: 4431791e3ce94f4cae4d648f1af2f186 Jun 23 11:44:23.146674 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-437706555 Jun 23 11:44:23.146674 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Role: member,reader Jun 23 11:44:23.146674 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Roles: member,reader Jun 23 11:44:23.147760 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4431791e3ce94f4cae4d648f1af2f186"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4431791e3ce94f4cae4d648f1af2f186"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4431791e3ce94f4cae4d648f1af2f186"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4431791e3ce94f4cae4d648f1af2f186"}]}] Jun 23 11:44:23.147760 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Tenant: tempest-VolumesSnapshotsTestJSON-437706555 Jun 23 11:44:23.147760 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Tenant-Id: 4431791e3ce94f4cae4d648f1af2f186 Jun 23 11:44:23.147760 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-437706555 Jun 23 11:44:23.147760 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User: tempest-VolumesSnapshotsTestJSON-437706555-project Jun 23 11:44:23.147760 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Domain-Id: default Jun 23 11:44:23.147760 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Domain-Name: Default Jun 23 11:44:23.147760 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Id: 72cb75b4931b42f6bd5f71fa0a99a15e Jun 23 11:44:23.147760 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Name: tempest-VolumesSnapshotsTestJSON-437706555-project Jun 23 11:44:23.147760 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: method: Jun 23 11:44:23.147760 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: exception: Volume 0ccbdec9-f2e6-4829-a236-2883c424085f could not be found. Jun 23 11:44:23.147760 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: action_args: {'id': '0ccbdec9-f2e6-4829-a236-2883c424085f'} Jun 23 11:44:23.147760 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:44:23.148489 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:44:23.148489 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 11:44:23.148489 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 11:44:23.148489 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 23 11:44:23.148489 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 23 11:44:23.148489 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 23 11:44:23.148489 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 23 11:44:23.148489 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 23 11:44:23.148489 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 23 11:44:23.148489 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 23 11:44:23.148489 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 23 11:44:23.148489 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 11:44:23.148489 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 11:44:23.148489 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 11:44:23.148489 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 11:44:23.148489 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0ccbdec9-f2e6-4829-a236-2883c424085f could not be found. (HTTP 404) (Request-ID: req-486e2f94-06f3-45ae-819c-7e336f525f30) Jun 23 11:44:23.148489 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:44:23.148489 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:44:23.148489 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:44:23.150971 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:44:23.150971 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 23 11:44:23.150971 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 23 11:44:23.150971 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 11:44:23.150971 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 11:44:23.150971 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 23 11:44:23.150971 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 23 11:44:23.150971 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 11:44:23.150971 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 11:44:23.150971 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 11:44:23.150971 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 11:44:23.150971 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 23 11:44:23.150971 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 23 11:44:23.150971 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 23 11:44:23.150971 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 23 11:44:23.150971 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 23 11:44:23.150971 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 23 11:44:23.150971 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 23 11:44:23.150971 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 23 11:44:23.151892 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 11:44:23.151892 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 11:44:23.151892 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 11:44:23.151892 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 11:44:23.151892 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0ccbdec9-f2e6-4829-a236-2883c424085f could not be found. Jun 23 11:44:23.151892 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:44:23.151892 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:44:23.151892 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:44:23.151892 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:44:23.151892 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:44:23.151892 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:44:23.151892 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:44:23.151892 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:44:23.151892 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 11:44:23.151892 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 11:44:23.151892 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:44:23.151892 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:44:23.151892 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 23 11:44:23.151892 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:44:23.152810 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0ccbdec9-f2e6-4829-a236-2883c424085f could not be found. Jun 23 11:44:23.152810 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:44:23.152810 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:44:23.152810 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:44:23.152810 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:44:23.152810 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:44:23.152810 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:44:23.152810 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:44:23.152810 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:44:23.152810 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0ccbdec9-f2e6-4829-a236-2883c424085f could not be found. Jun 23 11:44:23.152810 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:44:23.157510 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-12e11087-fddc-488e-bae7-e63a5da678c7 tempest-VolumesSnapshotsTestJSON-437706555 tempest-VolumesSnapshotsTestJSON-437706555-project] Returning 404 to user: Volume 0ccbdec9-f2e6-4829-a236-2883c424085f could not be found. {{(pid=124670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:44:23.158726 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-12e11087-fddc-488e-bae7-e63a5da678c7 tempest-VolumesSnapshotsTestJSON-437706555 tempest-VolumesSnapshotsTestJSON-437706555-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/0ccbdec9-f2e6-4829-a236-2883c424085f" status: 404 len: 109 microversion: 2.1 time: 0.079308 Jun 23 11:44:23.162466 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 21/40] 10.222.0.13 () {58 vars in 1247 bytes} [Thu Jun 23 11:44:23 2022] DELETE /compute/v2.1/os-volumes/0ccbdec9-f2e6-4829-a236-2883c424085f => generated 109 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:44:23.179701 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-4604915f-03be-4045-bd47-5029e1571e47 tempest-VolumesSnapshotsTestJSON-437706555 tempest-VolumesSnapshotsTestJSON-437706555-project] Calling method '.version_select at 0x7f5d06b090d0>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:23.227070 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.wsgi [None req-4604915f-03be-4045-bd47-5029e1571e47 tempest-VolumesSnapshotsTestJSON-437706555 tempest-VolumesSnapshotsTestJSON-437706555-project] HTTP exception thrown: Volume 0ccbdec9-f2e6-4829-a236-2883c424085f could not be found. Jun 23 11:44:23.229242 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-4604915f-03be-4045-bd47-5029e1571e47 tempest-VolumesSnapshotsTestJSON-437706555 tempest-VolumesSnapshotsTestJSON-437706555-project] Request method failure captured: Jun 23 11:44:23.229242 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: request: GET /compute/v2.1/os-volumes/0ccbdec9-f2e6-4829-a236-2883c424085f HTTP/1.1 Jun 23 11:44:23.229242 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Accept: application/json Jun 23 11:44:23.229242 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Accept-Encoding: identity Jun 23 11:44:23.229242 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Connection: close Jun 23 11:44:23.229242 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Content-Length: 0 Jun 23 11:44:23.229242 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Content-Type: application/json Jun 23 11:44:23.229242 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Host: 10.222.0.13 Jun 23 11:44:23.229242 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Openstack-System-Scope: None Jun 23 11:44:23.229242 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: User-Agent: python-urllib3/1.26.9 Jun 23 11:44:23.229242 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Auth-Token: gAAAAABitFIBSyXoUSWFXSe0sLUa3xzuXCLWpgMRHEYEhYNAAkyJL4rqFNNcQ2IdYfaJFiotz4-F02p86W69w2QXTXoosuL4909wOQcIrCw5AxLms_FEaVhT35GnzqECKHd8kHcFt8p0hMsFMr0BOvjlmHHZ3hwbW2STDSzisQMjXofoit-z7KI Jun 23 11:44:23.229242 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Domain-Id: None Jun 23 11:44:23.229242 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Domain-Name: None Jun 23 11:44:23.229242 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Identity-Status: Confirmed Jun 23 11:44:23.229242 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Is-Admin-Project: True Jun 23 11:44:23.229242 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Domain-Id: default Jun 23 11:44:23.229242 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Domain-Name: Default Jun 23 11:44:23.229242 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Id: 4431791e3ce94f4cae4d648f1af2f186 Jun 23 11:44:23.229242 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-437706555 Jun 23 11:44:23.229242 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Role: member,reader Jun 23 11:44:23.229242 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Roles: member,reader Jun 23 11:44:23.230295 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4431791e3ce94f4cae4d648f1af2f186"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4431791e3ce94f4cae4d648f1af2f186"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4431791e3ce94f4cae4d648f1af2f186"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4431791e3ce94f4cae4d648f1af2f186"}]}] Jun 23 11:44:23.230295 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Tenant: tempest-VolumesSnapshotsTestJSON-437706555 Jun 23 11:44:23.230295 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Tenant-Id: 4431791e3ce94f4cae4d648f1af2f186 Jun 23 11:44:23.230295 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-437706555 Jun 23 11:44:23.230295 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User: tempest-VolumesSnapshotsTestJSON-437706555-project Jun 23 11:44:23.230295 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Domain-Id: default Jun 23 11:44:23.230295 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Domain-Name: Default Jun 23 11:44:23.230295 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Id: 72cb75b4931b42f6bd5f71fa0a99a15e Jun 23 11:44:23.230295 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Name: tempest-VolumesSnapshotsTestJSON-437706555-project Jun 23 11:44:23.230295 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: method: Jun 23 11:44:23.230295 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: exception: Volume 0ccbdec9-f2e6-4829-a236-2883c424085f could not be found. Jun 23 11:44:23.230295 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: action_args: {'id': '0ccbdec9-f2e6-4829-a236-2883c424085f'} Jun 23 11:44:23.230295 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:44:23.230976 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:44:23.230976 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 11:44:23.230976 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 11:44:23.230976 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 11:44:23.230976 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 11:44:23.230976 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 11:44:23.230976 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 11:44:23.230976 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 11:44:23.230976 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 11:44:23.230976 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 11:44:23.230976 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 11:44:23.230976 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 11:44:23.230976 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 11:44:23.230976 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 11:44:23.230976 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 11:44:23.230976 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0ccbdec9-f2e6-4829-a236-2883c424085f could not be found. (HTTP 404) (Request-ID: req-4c5c04b3-b36c-4c23-9c25-8a7564a664cf) Jun 23 11:44:23.230976 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:44:23.230976 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:44:23.230976 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:44:23.231890 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:44:23.231890 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 23 11:44:23.231890 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 23 11:44:23.231890 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 11:44:23.231890 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 11:44:23.231890 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 23 11:44:23.231890 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 23 11:44:23.231890 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 11:44:23.231890 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 11:44:23.231890 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 11:44:23.231890 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 11:44:23.231890 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 11:44:23.231890 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 11:44:23.231890 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 11:44:23.231890 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 11:44:23.231890 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 11:44:23.231890 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 11:44:23.231890 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 11:44:23.231890 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 11:44:23.233389 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 11:44:23.233389 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 11:44:23.233389 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 11:44:23.233389 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 11:44:23.233389 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0ccbdec9-f2e6-4829-a236-2883c424085f could not be found. Jun 23 11:44:23.233389 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:44:23.233389 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:44:23.233389 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:44:23.233389 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:44:23.233389 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:44:23.233389 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:44:23.233389 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:44:23.233389 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:44:23.233389 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 11:44:23.233389 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 11:44:23.233389 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:44:23.233389 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:44:23.233389 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 23 11:44:23.233389 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:44:23.234479 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0ccbdec9-f2e6-4829-a236-2883c424085f could not be found. Jun 23 11:44:23.234479 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:44:23.234479 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:44:23.234479 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:44:23.234479 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:44:23.234479 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:44:23.234479 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:44:23.234479 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:44:23.234479 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:44:23.234479 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0ccbdec9-f2e6-4829-a236-2883c424085f could not be found. Jun 23 11:44:23.234479 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:44:23.236901 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-4604915f-03be-4045-bd47-5029e1571e47 tempest-VolumesSnapshotsTestJSON-437706555 tempest-VolumesSnapshotsTestJSON-437706555-project] Returning 404 to user: Volume 0ccbdec9-f2e6-4829-a236-2883c424085f could not be found. {{(pid=124670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:44:23.237873 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-4604915f-03be-4045-bd47-5029e1571e47 tempest-VolumesSnapshotsTestJSON-437706555 tempest-VolumesSnapshotsTestJSON-437706555-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/0ccbdec9-f2e6-4829-a236-2883c424085f" status: 404 len: 109 microversion: 2.1 time: 0.070210 Jun 23 11:44:23.238969 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 22/41] 10.222.0.13 () {58 vars in 1244 bytes} [Thu Jun 23 11:44:23 2022] GET /compute/v2.1/os-volumes/0ccbdec9-f2e6-4829-a236-2883c424085f => generated 109 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:44:23.692570 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-8d80db9a-20ae-4fb4-b198-ea269ba51c3c tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:23.692570 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-8d80db9a-20ae-4fb4-b198-ea269ba51c3c tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 250e2ce6-70ad-4082-8073-6a9cea0ca1e4] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:24.032401 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-8d80db9a-20ae-4fb4-b198-ea269ba51c3c tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:24.041423 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-8d80db9a-20ae-4fb4-b198-ea269ba51c3c tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4" status: 200 len: 1242 microversion: 2.1 time: 0.359910 Jun 23 11:44:24.049239 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 23/42] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:23 2022] GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4 => generated 1242 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:44:24.095748 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-1625f171-5e78-4d3e-b3df-b9c59442d10b tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:24.096444 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-1625f171-5e78-4d3e-b3df-b9c59442d10b tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 0953fa06-0916-418f-b527-06d088cc6066] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:24.107285 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1625f171-5e78-4d3e-b3df-b9c59442d10b tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:24.112996 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1625f171-5e78-4d3e-b3df-b9c59442d10b tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:24.116521 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1625f171-5e78-4d3e-b3df-b9c59442d10b tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:24.118188 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1625f171-5e78-4d3e-b3df-b9c59442d10b tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:24.123321 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.virt.hardware [None req-103c1089-6375-4f2b-98c6-ed2004f660ee tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Flavor limits 0:0:0 {{(pid=124669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 11:44:24.123892 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.virt.hardware [None req-103c1089-6375-4f2b-98c6-ed2004f660ee tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Image limits 0:0:0 {{(pid=124669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 11:44:24.124525 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.virt.hardware [None req-103c1089-6375-4f2b-98c6-ed2004f660ee tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Flavor pref 0:0:0 {{(pid=124669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 11:44:24.125075 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.virt.hardware [None req-103c1089-6375-4f2b-98c6-ed2004f660ee tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Image pref 0:0:0 {{(pid=124669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 11:44:24.125654 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.virt.hardware [None req-103c1089-6375-4f2b-98c6-ed2004f660ee tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 11:44:24.146227 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-103c1089-6375-4f2b-98c6-ed2004f660ee tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:24.147436 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-103c1089-6375-4f2b-98c6-ed2004f660ee tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:24.148773 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-103c1089-6375-4f2b-98c6-ed2004f660ee tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:24.149367 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-103c1089-6375-4f2b-98c6-ed2004f660ee tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:24.201022 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.quota [None req-103c1089-6375-4f2b-98c6-ed2004f660ee tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Getting quotas for project 515e65a705ee46cc8f8e03efbe58f177. Resources: {'cores', 'instances', 'ram'} {{(pid=124669) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:44:24.210243 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.quota [None req-103c1089-6375-4f2b-98c6-ed2004f660ee tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Getting quotas for user ae72d6c494ba4f16989adfe090803d47 and project 515e65a705ee46cc8f8e03efbe58f177. Resources: {'cores', 'instances', 'ram'} {{(pid=124669) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:44:24.231548 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-103c1089-6375-4f2b-98c6-ed2004f660ee tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Going to run 1 instances... {{(pid=124669) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 11:44:24.237168 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-103c1089-6375-4f2b-98c6-ed2004f660ee tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] [instance: 16a06134-ea93-492f-a705-29cc31876c5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b19d6f23-214c-4432-bee6-455978023759',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124669) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 11:44:24.365666 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-1625f171-5e78-4d3e-b3df-b9c59442d10b tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:24.393311 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-1625f171-5e78-4d3e-b3df-b9c59442d10b tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066" status: 200 len: 1218 microversion: 2.1 time: 0.302392 Jun 23 11:44:24.414919 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 24/43] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:24 2022] GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066 => generated 1218 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:44:24.423395 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-741a91f1-ee04-4deb-95c9-3bc72159c5c9 tempest-VolumesTestJSON-2011332813 tempest-VolumesTestJSON-2011332813-project] Calling method '.version_select at 0x7f5d06a73820>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:24.441119 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-103c1089-6375-4f2b-98c6-ed2004f660ee tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.421831 Jun 23 11:44:24.449289 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 20/44] 10.222.0.13 () {60 vars in 1146 bytes} [Thu Jun 23 11:44:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 2428 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 11:44:24.467929 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-43e40e90-3e72-41be-93cf-bf93c4a0af66 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:24.468608 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-43e40e90-3e72-41be-93cf-bf93c4a0af66 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] [instance: 16a06134-ea93-492f-a705-29cc31876c5d] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:24.625550 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-43e40e90-3e72-41be-93cf-bf93c4a0af66 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae72d6c494ba4f16989adfe090803d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515e65a705ee46cc8f8e03efbe58f177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:24.635828 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-43e40e90-3e72-41be-93cf-bf93c4a0af66 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] 10.222.0.13 "GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d" status: 200 len: 1214 microversion: 2.1 time: 0.186091 Jun 23 11:44:24.636737 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 21/45] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:24 2022] GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d => generated 1214 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:44:24.659561 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-741a91f1-ee04-4deb-95c9-3bc72159c5c9 tempest-VolumesTestJSON-2011332813 tempest-VolumesTestJSON-2011332813-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/24895afb-7e71-43b5-a95c-3befad71b9e8" status: 200 len: 349 microversion: 2.1 time: 0.243428 Jun 23 11:44:24.660131 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 25/46] 10.222.0.13 () {58 vars in 1244 bytes} [Thu Jun 23 11:44:24 2022] GET /compute/v2.1/os-volumes/24895afb-7e71-43b5-a95c-3befad71b9e8 => generated 349 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:44:24.672698 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-9a3a67c6-a61c-45c8-9cfb-d5072bc232e6 tempest-VolumesTestJSON-2011332813 tempest-VolumesTestJSON-2011332813-project] Calling method '.version_select at 0x7f5d07b45430>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:24.949981 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-9a3a67c6-a61c-45c8-9cfb-d5072bc232e6 tempest-VolumesTestJSON-2011332813 tempest-VolumesTestJSON-2011332813-project] 10.222.0.13 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.282070 Jun 23 11:44:24.950814 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 22/47] 10.222.0.13 () {58 vars in 1133 bytes} [Thu Jun 23 11:44:24 2022] GET /compute/v2.1/os-volumes => generated 1032 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:44:24.965024 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-327cf74c-bd67-407d-9e2d-2cf3531162c6 tempest-VolumesTestJSON-2011332813 tempest-VolumesTestJSON-2011332813-project] Calling method '.version_select at 0x7f5d06a73f70>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:25.072398 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-eea9fbb1-35c1-4f03-9480-e5978afbafde tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:25.074281 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-eea9fbb1-35c1-4f03-9480-e5978afbafde tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 250e2ce6-70ad-4082-8073-6a9cea0ca1e4] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:25.234816 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-eea9fbb1-35c1-4f03-9480-e5978afbafde tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:25.243960 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-eea9fbb1-35c1-4f03-9480-e5978afbafde tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4" status: 200 len: 1242 microversion: 2.1 time: 0.182943 Jun 23 11:44:25.245135 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 23/48] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:25 2022] GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4 => generated 1242 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:44:25.283868 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-327cf74c-bd67-407d-9e2d-2cf3531162c6 tempest-VolumesTestJSON-2011332813 tempest-VolumesTestJSON-2011332813-project] 10.222.0.13 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.323632 Jun 23 11:44:25.284921 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 26/49] 10.222.0.13 () {58 vars in 1148 bytes} [Thu Jun 23 11:44:24 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 692 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:44:25.298293 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-9d5730ae-0dfb-4490-9f45-f8df4c355b44 tempest-VolumesTestJSON-2011332813 tempest-VolumesTestJSON-2011332813-project] Calling method '.version_select at 0x7f5d07b58940>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:25.426070 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-20b3fcce-c910-4953-9555-05f25d93e23b tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:25.426070 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-20b3fcce-c910-4953-9555-05f25d93e23b tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 0953fa06-0916-418f-b527-06d088cc6066] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:25.426070 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-20b3fcce-c910-4953-9555-05f25d93e23b tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:25.426070 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-20b3fcce-c910-4953-9555-05f25d93e23b tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:25.426451 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-20b3fcce-c910-4953-9555-05f25d93e23b tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:25.426451 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-20b3fcce-c910-4953-9555-05f25d93e23b tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:25.475611 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-9d5730ae-0dfb-4490-9f45-f8df4c355b44 tempest-VolumesTestJSON-2011332813 tempest-VolumesTestJSON-2011332813-project] 10.222.0.13 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.182920 Jun 23 11:44:25.476572 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 24/50] 10.222.0.13 () {58 vars in 1133 bytes} [Thu Jun 23 11:44:25 2022] GET /compute/v2.1/os-volumes => generated 1032 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:44:25.492526 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-e2e70817-dde5-4ed0-be2f-04a56c988caf tempest-VolumesTestJSON-2011332813 tempest-VolumesTestJSON-2011332813-project] Calling method '.version_select at 0x7f5d07b45dc0>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:25.632464 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-20b3fcce-c910-4953-9555-05f25d93e23b tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:25.674005 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-20b3fcce-c910-4953-9555-05f25d93e23b tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066" status: 200 len: 1274 microversion: 2.1 time: 0.265939 Jun 23 11:44:25.689105 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 27/51] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:25 2022] GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066 => generated 1274 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:44:25.699992 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-e2e70817-dde5-4ed0-be2f-04a56c988caf tempest-VolumesTestJSON-2011332813 tempest-VolumesTestJSON-2011332813-project] 10.222.0.13 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.215684 Jun 23 11:44:25.701946 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 25/52] 10.222.0.13 () {58 vars in 1166 bytes} [Thu Jun 23 11:44:25 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:44:25.715274 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-82e00d86-fc29-4555-8f4a-aa22ba97a83b tempest-VolumesTestJSON-2011332813 tempest-VolumesTestJSON-2011332813-project] Calling method '.version_select at 0x7f5d07b65700>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:25.724082 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-718ecfa4-81fa-41f5-bc32-8e1b3e193409 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:25.739588 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-718ecfa4-81fa-41f5-bc32-8e1b3e193409 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] [instance: 16a06134-ea93-492f-a705-29cc31876c5d] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:25.825467 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-718ecfa4-81fa-41f5-bc32-8e1b3e193409 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae72d6c494ba4f16989adfe090803d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515e65a705ee46cc8f8e03efbe58f177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:25.851197 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-718ecfa4-81fa-41f5-bc32-8e1b3e193409 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] 10.222.0.13 "GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d" status: 200 len: 1214 microversion: 2.1 time: 0.160295 Jun 23 11:44:25.864966 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 28/53] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:25 2022] GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d => generated 1214 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:44:26.116745 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-82e00d86-fc29-4555-8f4a-aa22ba97a83b tempest-VolumesTestJSON-2011332813 tempest-VolumesTestJSON-2011332813-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.406754 Jun 23 11:44:26.117267 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 26/54] 10.222.0.13 () {58 vars in 1169 bytes} [Thu Jun 23 11:44:25 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 692 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:44:26.131419 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-0af6896e-d691-434c-8d93-2587f3ab3143 tempest-VolumesTestJSON-2011332813 tempest-VolumesTestJSON-2011332813-project] Calling method '.version_select at 0x7f5d06aa95e0>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:26.261937 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-cb159c72-bc43-4b57-9425-0668cc49e805 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:26.263310 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-cb159c72-bc43-4b57-9425-0668cc49e805 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 250e2ce6-70ad-4082-8073-6a9cea0ca1e4] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:26.278038 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-cb159c72-bc43-4b57-9425-0668cc49e805 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:26.278507 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-cb159c72-bc43-4b57-9425-0668cc49e805 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:26.282163 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-cb159c72-bc43-4b57-9425-0668cc49e805 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:26.282652 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-cb159c72-bc43-4b57-9425-0668cc49e805 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:26.296108 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-0af6896e-d691-434c-8d93-2587f3ab3143 tempest-VolumesTestJSON-2011332813 tempest-VolumesTestJSON-2011332813-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.169124 Jun 23 11:44:26.297163 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 29/55] 10.222.0.13 () {58 vars in 1154 bytes} [Thu Jun 23 11:44:26 2022] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:44:26.310210 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-1a141a0e-4244-4315-bb4a-c1e0bd851184 tempest-VolumesTestJSON-2011332813 tempest-VolumesTestJSON-2011332813-project] Calling method '.version_select at 0x7f5d06a82790>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:26.515448 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-1a141a0e-4244-4315-bb4a-c1e0bd851184 tempest-VolumesTestJSON-2011332813 tempest-VolumesTestJSON-2011332813-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.209896 Jun 23 11:44:26.523914 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 30/56] 10.222.0.13 () {58 vars in 1187 bytes} [Thu Jun 23 11:44:26 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:44:26.531960 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-d3f13b26-e993-48b0-9ab8-f53349f0aa1b tempest-VolumesTestJSON-2011332813 tempest-VolumesTestJSON-2011332813-project] Calling method '.version_select at 0x7f5d06a7a1f0>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:26.737973 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-cb159c72-bc43-4b57-9425-0668cc49e805 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:26.755326 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-d3f13b26-e993-48b0-9ab8-f53349f0aa1b tempest-VolumesTestJSON-2011332813 tempest-VolumesTestJSON-2011332813-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.228812 Jun 23 11:44:26.756129 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 31/57] 10.222.0.13 () {58 vars in 1154 bytes} [Thu Jun 23 11:44:26 2022] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:44:26.764881 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-cb159c72-bc43-4b57-9425-0668cc49e805 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4" status: 200 len: 1238 microversion: 2.1 time: 0.507307 Jun 23 11:44:26.769757 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 27/58] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:26 2022] GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4 => generated 1238 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:44:26.778994 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-b2e03ec6-507c-4d49-8d04-3c87cc85ae63 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:26.781329 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-b2e03ec6-507c-4d49-8d04-3c87cc85ae63 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 0953fa06-0916-418f-b527-06d088cc6066] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:26.806415 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-b2e03ec6-507c-4d49-8d04-3c87cc85ae63 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:26.807240 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-b2e03ec6-507c-4d49-8d04-3c87cc85ae63 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:26.808469 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-b2e03ec6-507c-4d49-8d04-3c87cc85ae63 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:26.809383 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-b2e03ec6-507c-4d49-8d04-3c87cc85ae63 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:26.873138 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-3f0b717b-40db-4c90-8b4b-e1d10f849a5d tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:26.873972 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-3f0b717b-40db-4c90-8b4b-e1d10f849a5d tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] [instance: 16a06134-ea93-492f-a705-29cc31876c5d] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:26.886164 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-3f0b717b-40db-4c90-8b4b-e1d10f849a5d tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:26.886645 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-3f0b717b-40db-4c90-8b4b-e1d10f849a5d tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:26.887421 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-3f0b717b-40db-4c90-8b4b-e1d10f849a5d tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:26.895702 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-3f0b717b-40db-4c90-8b4b-e1d10f849a5d tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:27.023505 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-b2e03ec6-507c-4d49-8d04-3c87cc85ae63 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:27.037040 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-b2e03ec6-507c-4d49-8d04-3c87cc85ae63 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066" status: 200 len: 1280 microversion: 2.1 time: 0.277107 Jun 23 11:44:27.037739 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 32/59] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:26 2022] GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066 => generated 1280 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:44:27.217777 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-3f0b717b-40db-4c90-8b4b-e1d10f849a5d tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae72d6c494ba4f16989adfe090803d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515e65a705ee46cc8f8e03efbe58f177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:27.246233 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-3f0b717b-40db-4c90-8b4b-e1d10f849a5d tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] 10.222.0.13 "GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d" status: 200 len: 1218 microversion: 2.1 time: 0.376647 Jun 23 11:44:27.264022 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 28/60] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:26 2022] GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d => generated 1218 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:44:27.786456 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-fc57c1b4-6762-4bae-9f6c-3ebb1f1e0aef tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:27.787116 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-fc57c1b4-6762-4bae-9f6c-3ebb1f1e0aef tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 250e2ce6-70ad-4082-8073-6a9cea0ca1e4] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:27.800818 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-fc57c1b4-6762-4bae-9f6c-3ebb1f1e0aef tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:27.807694 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-fc57c1b4-6762-4bae-9f6c-3ebb1f1e0aef tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:27.809296 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-fc57c1b4-6762-4bae-9f6c-3ebb1f1e0aef tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:27.817417 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-fc57c1b4-6762-4bae-9f6c-3ebb1f1e0aef tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:28.068559 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-dfeae9eb-fd3e-46de-8069-f9719f7dde9e tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:28.068559 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-dfeae9eb-fd3e-46de-8069-f9719f7dde9e tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 0953fa06-0916-418f-b527-06d088cc6066] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:28.090604 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-dfeae9eb-fd3e-46de-8069-f9719f7dde9e tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:28.091115 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-dfeae9eb-fd3e-46de-8069-f9719f7dde9e tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:28.098119 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-dfeae9eb-fd3e-46de-8069-f9719f7dde9e tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:28.109327 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-dfeae9eb-fd3e-46de-8069-f9719f7dde9e tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:28.204603 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-fc57c1b4-6762-4bae-9f6c-3ebb1f1e0aef tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:28.217827 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-fc57c1b4-6762-4bae-9f6c-3ebb1f1e0aef tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4" status: 200 len: 1302 microversion: 2.1 time: 0.435832 Jun 23 11:44:28.241129 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 33/61] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:27 2022] GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4 => generated 1302 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:44:28.270784 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-af09ddaf-177f-4b06-b59c-2892d2e7f95e tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:28.271573 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-af09ddaf-177f-4b06-b59c-2892d2e7f95e tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] [instance: 16a06134-ea93-492f-a705-29cc31876c5d] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:28.283871 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-af09ddaf-177f-4b06-b59c-2892d2e7f95e tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:28.289579 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-af09ddaf-177f-4b06-b59c-2892d2e7f95e tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:28.293087 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-af09ddaf-177f-4b06-b59c-2892d2e7f95e tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:28.293087 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-af09ddaf-177f-4b06-b59c-2892d2e7f95e tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:28.620224 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-dfeae9eb-fd3e-46de-8069-f9719f7dde9e tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:28.630909 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-dfeae9eb-fd3e-46de-8069-f9719f7dde9e tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066" status: 200 len: 1280 microversion: 2.1 time: 0.578574 Jun 23 11:44:28.658731 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 29/62] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:28 2022] GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066 => generated 1280 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:44:29.007035 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-af09ddaf-177f-4b06-b59c-2892d2e7f95e tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae72d6c494ba4f16989adfe090803d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515e65a705ee46cc8f8e03efbe58f177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:29.021560 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-af09ddaf-177f-4b06-b59c-2892d2e7f95e tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] 10.222.0.13 "GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d" status: 200 len: 1266 microversion: 2.1 time: 0.754140 Jun 23 11:44:29.022170 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 34/63] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:28 2022] GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d => generated 1266 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:44:29.251349 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-0aa6bde0-1f1b-413c-a7ba-704d2b4a6760 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:29.252349 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-0aa6bde0-1f1b-413c-a7ba-704d2b4a6760 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 250e2ce6-70ad-4082-8073-6a9cea0ca1e4] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:29.276197 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-0aa6bde0-1f1b-413c-a7ba-704d2b4a6760 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:29.280077 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-0aa6bde0-1f1b-413c-a7ba-704d2b4a6760 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:29.280077 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-0aa6bde0-1f1b-413c-a7ba-704d2b4a6760 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:29.287013 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-0aa6bde0-1f1b-413c-a7ba-704d2b4a6760 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:29.650965 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-619a5f9c-8521-482e-99d1-f5c4c84cfd0f tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:29.655940 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-619a5f9c-8521-482e-99d1-f5c4c84cfd0f tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 0953fa06-0916-418f-b527-06d088cc6066] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:29.668782 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-619a5f9c-8521-482e-99d1-f5c4c84cfd0f tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:29.669291 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-619a5f9c-8521-482e-99d1-f5c4c84cfd0f tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:29.680709 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-619a5f9c-8521-482e-99d1-f5c4c84cfd0f tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:29.680709 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-619a5f9c-8521-482e-99d1-f5c4c84cfd0f tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:29.785488 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-0aa6bde0-1f1b-413c-a7ba-704d2b4a6760 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:29.807762 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-0aa6bde0-1f1b-413c-a7ba-704d2b4a6760 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4" status: 200 len: 1300 microversion: 2.1 time: 0.563526 Jun 23 11:44:29.812461 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 30/64] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:29 2022] GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4 => generated 1300 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:44:30.039320 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-36f2a954-f679-4335-b8c3-bf3299c86574 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:30.040292 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-36f2a954-f679-4335-b8c3-bf3299c86574 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] [instance: 16a06134-ea93-492f-a705-29cc31876c5d] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:30.056986 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-36f2a954-f679-4335-b8c3-bf3299c86574 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:30.067470 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-36f2a954-f679-4335-b8c3-bf3299c86574 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:30.069899 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-36f2a954-f679-4335-b8c3-bf3299c86574 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:30.071863 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-36f2a954-f679-4335-b8c3-bf3299c86574 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:30.302601 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-619a5f9c-8521-482e-99d1-f5c4c84cfd0f tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:30.318525 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-619a5f9c-8521-482e-99d1-f5c4c84cfd0f tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066" status: 200 len: 1280 microversion: 2.1 time: 0.672877 Jun 23 11:44:30.323537 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 35/65] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:29 2022] GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066 => generated 1280 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:44:30.507596 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-36f2a954-f679-4335-b8c3-bf3299c86574 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae72d6c494ba4f16989adfe090803d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515e65a705ee46cc8f8e03efbe58f177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:30.523894 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-36f2a954-f679-4335-b8c3-bf3299c86574 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] 10.222.0.13 "GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d" status: 200 len: 1274 microversion: 2.1 time: 0.488529 Jun 23 11:44:30.526493 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 31/66] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:30 2022] GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d => generated 1274 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:44:30.831176 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-cf41e04a-2b8c-4fe7-be20-1e35a91abc37 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:30.832302 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-cf41e04a-2b8c-4fe7-be20-1e35a91abc37 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 250e2ce6-70ad-4082-8073-6a9cea0ca1e4] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:30.845829 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-cf41e04a-2b8c-4fe7-be20-1e35a91abc37 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:30.848622 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-cf41e04a-2b8c-4fe7-be20-1e35a91abc37 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:30.850832 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-cf41e04a-2b8c-4fe7-be20-1e35a91abc37 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:30.851499 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-cf41e04a-2b8c-4fe7-be20-1e35a91abc37 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:31.112442 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-cf41e04a-2b8c-4fe7-be20-1e35a91abc37 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:31.127302 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-cf41e04a-2b8c-4fe7-be20-1e35a91abc37 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4" status: 200 len: 1300 microversion: 2.1 time: 0.300196 Jun 23 11:44:31.130681 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 36/67] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:30 2022] GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4 => generated 1300 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:44:31.343351 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-f6b4dd3d-107d-490b-9397-9fdc2637bd3a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:31.343981 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-f6b4dd3d-107d-490b-9397-9fdc2637bd3a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 0953fa06-0916-418f-b527-06d088cc6066] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:31.358684 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-f6b4dd3d-107d-490b-9397-9fdc2637bd3a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:31.363054 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-f6b4dd3d-107d-490b-9397-9fdc2637bd3a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:31.377500 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-f6b4dd3d-107d-490b-9397-9fdc2637bd3a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:31.379249 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-f6b4dd3d-107d-490b-9397-9fdc2637bd3a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:31.541989 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-8064dbb9-4c51-4676-bbad-16c20163afbb tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:31.542853 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-8064dbb9-4c51-4676-bbad-16c20163afbb tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] [instance: 16a06134-ea93-492f-a705-29cc31876c5d] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:31.547621 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_cell0:SELECT=4 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:31.551257 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=8 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:31.599732 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-8064dbb9-4c51-4676-bbad-16c20163afbb tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:31.600203 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-8064dbb9-4c51-4676-bbad-16c20163afbb tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:31.622630 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-8064dbb9-4c51-4676-bbad-16c20163afbb tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:31.624488 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-8064dbb9-4c51-4676-bbad-16c20163afbb tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:31.814983 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-f6b4dd3d-107d-490b-9397-9fdc2637bd3a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:31.827252 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-f6b4dd3d-107d-490b-9397-9fdc2637bd3a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066" status: 200 len: 1280 microversion: 2.1 time: 0.493697 Jun 23 11:44:31.839095 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 32/68] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:31 2022] GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066 => generated 1280 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:44:32.014554 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-8064dbb9-4c51-4676-bbad-16c20163afbb tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae72d6c494ba4f16989adfe090803d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515e65a705ee46cc8f8e03efbe58f177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:32.038227 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-8064dbb9-4c51-4676-bbad-16c20163afbb tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] 10.222.0.13 "GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d" status: 200 len: 1272 microversion: 2.1 time: 0.500715 Jun 23 11:44:32.040801 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 37/69] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:31 2022] GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d => generated 1272 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:44:32.146881 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-ddbc5844-c6e9-4222-bd57-e0d3ede31d7e tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:32.148533 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-ddbc5844-c6e9-4222-bd57-e0d3ede31d7e tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 250e2ce6-70ad-4082-8073-6a9cea0ca1e4] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:32.173088 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ddbc5844-c6e9-4222-bd57-e0d3ede31d7e tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:32.175554 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ddbc5844-c6e9-4222-bd57-e0d3ede31d7e tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:32.178744 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ddbc5844-c6e9-4222-bd57-e0d3ede31d7e tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:32.179218 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ddbc5844-c6e9-4222-bd57-e0d3ede31d7e tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:32.654521 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-ddbc5844-c6e9-4222-bd57-e0d3ede31d7e tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:32.670418 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-ddbc5844-c6e9-4222-bd57-e0d3ede31d7e tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4" status: 200 len: 1300 microversion: 2.1 time: 0.527726 Jun 23 11:44:32.688629 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 33/70] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:32 2022] GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4 => generated 1300 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:44:32.847562 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-c9881909-076f-4652-807b-f95b0849e5b5 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:32.848310 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-c9881909-076f-4652-807b-f95b0849e5b5 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 0953fa06-0916-418f-b527-06d088cc6066] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:32.869342 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-c9881909-076f-4652-807b-f95b0849e5b5 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:32.869805 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-c9881909-076f-4652-807b-f95b0849e5b5 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:32.870628 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-c9881909-076f-4652-807b-f95b0849e5b5 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:32.871074 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-c9881909-076f-4652-807b-f95b0849e5b5 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:33.062609 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-c3e47b33-59be-48bc-b904-5192cdd1dada tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:33.063150 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-c3e47b33-59be-48bc-b904-5192cdd1dada tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] [instance: 16a06134-ea93-492f-a705-29cc31876c5d] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:33.081379 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c3e47b33-59be-48bc-b904-5192cdd1dada tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:33.088176 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c3e47b33-59be-48bc-b904-5192cdd1dada tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:33.088176 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c3e47b33-59be-48bc-b904-5192cdd1dada tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:33.088176 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c3e47b33-59be-48bc-b904-5192cdd1dada tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:33.270002 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-c3e47b33-59be-48bc-b904-5192cdd1dada tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae72d6c494ba4f16989adfe090803d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515e65a705ee46cc8f8e03efbe58f177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:33.288960 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-c3e47b33-59be-48bc-b904-5192cdd1dada tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] 10.222.0.13 "GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d" status: 200 len: 1272 microversion: 2.1 time: 0.234918 Jun 23 11:44:33.294770 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 34/71] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:33 2022] GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d => generated 1272 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:44:33.345272 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-1ec83e7d-4a63-4a9f-8962-63290d348ca4 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1656912078", "imageRef": "b19d6f23-214c-4432-bee6-455978023759", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6028cdda-cfa0-48e7-849f-0656110a3a2b"}], "security_groups": [{"name": "tempest-securitygroup--1972558502"}], "key_name": "tempest-keypair-1124038880", "user_data": "}} {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:44:33.450877 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-c9881909-076f-4652-807b-f95b0849e5b5 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:33.474620 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-c9881909-076f-4652-807b-f95b0849e5b5 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066" status: 200 len: 1322 microversion: 2.1 time: 0.633211 Jun 23 11:44:33.490867 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 38/72] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:32 2022] GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066 => generated 1322 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:44:33.596666 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.network.neutron [None req-1ec83e7d-4a63-4a9f-8962-63290d348ca4 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] validate_networks() for [('6028cdda-cfa0-48e7-849f-0656110a3a2b', None, None, None, None, None)] {{(pid=124669) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 11:44:33.695536 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-27d77bcf-321d-4d49-a642-d7b48f7cbfeb tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:33.696345 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-27d77bcf-321d-4d49-a642-d7b48f7cbfeb tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 250e2ce6-70ad-4082-8073-6a9cea0ca1e4] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:33.706233 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-27d77bcf-321d-4d49-a642-d7b48f7cbfeb tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:33.707042 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-27d77bcf-321d-4d49-a642-d7b48f7cbfeb tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:33.708297 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-27d77bcf-321d-4d49-a642-d7b48f7cbfeb tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:33.709322 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-27d77bcf-321d-4d49-a642-d7b48f7cbfeb tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:33.819508 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-27d77bcf-321d-4d49-a642-d7b48f7cbfeb tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:33.838610 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-27d77bcf-321d-4d49-a642-d7b48f7cbfeb tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4" status: 200 len: 1300 microversion: 2.1 time: 0.151762 Jun 23 11:44:33.841066 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 39/73] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:33 2022] GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4 => generated 1300 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:44:34.182347 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_cell0:SELECT=4 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:34.308523 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-d6a86c73-90b7-49e6-b5f3-bc5918cc8ab8 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:34.309822 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-d6a86c73-90b7-49e6-b5f3-bc5918cc8ab8 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] [instance: 16a06134-ea93-492f-a705-29cc31876c5d] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:34.326505 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-d6a86c73-90b7-49e6-b5f3-bc5918cc8ab8 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:34.334337 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-d6a86c73-90b7-49e6-b5f3-bc5918cc8ab8 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:34.334910 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-d6a86c73-90b7-49e6-b5f3-bc5918cc8ab8 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:34.336303 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-d6a86c73-90b7-49e6-b5f3-bc5918cc8ab8 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:34.985010 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-d6a86c73-90b7-49e6-b5f3-bc5918cc8ab8 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae72d6c494ba4f16989adfe090803d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515e65a705ee46cc8f8e03efbe58f177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:34.998324 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-d6a86c73-90b7-49e6-b5f3-bc5918cc8ab8 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] 10.222.0.13 "GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d" status: 200 len: 1314 microversion: 2.1 time: 0.695717 Jun 23 11:44:35.008037 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 40/74] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:34 2022] GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d => generated 1314 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:44:35.042494 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-f9db6516-90a5-40cc-b1f6-157a8dd80c01 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:35.043169 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-f9db6516-90a5-40cc-b1f6-157a8dd80c01 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 0953fa06-0916-418f-b527-06d088cc6066] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:35.061647 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-f9db6516-90a5-40cc-b1f6-157a8dd80c01 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:35.062585 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-f9db6516-90a5-40cc-b1f6-157a8dd80c01 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:35.063762 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-f9db6516-90a5-40cc-b1f6-157a8dd80c01 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:35.064466 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-f9db6516-90a5-40cc-b1f6-157a8dd80c01 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:35.241089 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_cell0:SELECT=18 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:35.745415 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.virt.hardware [None req-1ec83e7d-4a63-4a9f-8962-63290d348ca4 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Flavor limits 0:0:0 {{(pid=124669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 11:44:35.746277 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.virt.hardware [None req-1ec83e7d-4a63-4a9f-8962-63290d348ca4 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Image limits 0:0:0 {{(pid=124669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 11:44:35.747020 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.virt.hardware [None req-1ec83e7d-4a63-4a9f-8962-63290d348ca4 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Flavor pref 0:0:0 {{(pid=124669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 11:44:35.748544 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.virt.hardware [None req-1ec83e7d-4a63-4a9f-8962-63290d348ca4 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Image pref 0:0:0 {{(pid=124669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 11:44:35.749284 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.virt.hardware [None req-1ec83e7d-4a63-4a9f-8962-63290d348ca4 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 11:44:35.791021 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-1ec83e7d-4a63-4a9f-8962-63290d348ca4 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:35.796495 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-1ec83e7d-4a63-4a9f-8962-63290d348ca4 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:35.801302 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-1ec83e7d-4a63-4a9f-8962-63290d348ca4 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:35.805746 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-1ec83e7d-4a63-4a9f-8962-63290d348ca4 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:35.839565 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_cell0:SELECT=28 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:35.863644 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-f9db6516-90a5-40cc-b1f6-157a8dd80c01 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:35.876698 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-f9db6516-90a5-40cc-b1f6-157a8dd80c01 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066" status: 200 len: 1322 microversion: 2.1 time: 0.846748 Jun 23 11:44:35.883416 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.quota [None req-1ec83e7d-4a63-4a9f-8962-63290d348ca4 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Getting quotas for project 45db495ff8c04b55b44c80a3ab412fb9. Resources: {'cores', 'instances', 'ram'} {{(pid=124669) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:44:35.888755 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 41/75] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:35 2022] GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066 => generated 1322 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:44:35.900428 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-4f204fe9-5bc0-4744-a553-24a459618f9f tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:35.905779 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-4f204fe9-5bc0-4744-a553-24a459618f9f tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 250e2ce6-70ad-4082-8073-6a9cea0ca1e4] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:35.954291 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-4f204fe9-5bc0-4744-a553-24a459618f9f tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:35.954633 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-4f204fe9-5bc0-4744-a553-24a459618f9f tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:35.963811 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-4f204fe9-5bc0-4744-a553-24a459618f9f tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:35.963811 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-4f204fe9-5bc0-4744-a553-24a459618f9f tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:35.964000 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.quota [None req-1ec83e7d-4a63-4a9f-8962-63290d348ca4 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Getting quotas for user d1b988f3241a46308b7c3683e2943b78 and project 45db495ff8c04b55b44c80a3ab412fb9. Resources: {'cores', 'instances', 'ram'} {{(pid=124669) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:44:36.030905 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-1ec83e7d-4a63-4a9f-8962-63290d348ca4 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Going to run 1 instances... {{(pid=124669) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 11:44:36.035864 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-1ec83e7d-4a63-4a9f-8962-63290d348ca4 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b19d6f23-214c-4432-bee6-455978023759',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124669) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 11:44:36.307901 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-1ec83e7d-4a63-4a9f-8962-63290d348ca4 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.970040 Jun 23 11:44:36.324480 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 35/76] 10.222.0.13 () {60 vars in 1146 bytes} [Thu Jun 23 11:44:33 2022] POST /compute/v2.1/servers => generated 402 bytes in 2988 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 11:44:36.341663 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-03f8c1b9-2436-42b8-ad9f-b0713d24b1e5 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:36.347294 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-03f8c1b9-2436-42b8-ad9f-b0713d24b1e5 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] [instance: 16a06134-ea93-492f-a705-29cc31876c5d] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:36.378130 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-03f8c1b9-2436-42b8-ad9f-b0713d24b1e5 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:36.378130 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-03f8c1b9-2436-42b8-ad9f-b0713d24b1e5 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:36.378130 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-03f8c1b9-2436-42b8-ad9f-b0713d24b1e5 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:36.378130 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-03f8c1b9-2436-42b8-ad9f-b0713d24b1e5 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:36.779073 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-4f204fe9-5bc0-4744-a553-24a459618f9f tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:36.791217 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-4f204fe9-5bc0-4744-a553-24a459618f9f tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4" status: 200 len: 1368 microversion: 2.1 time: 0.901115 Jun 23 11:44:36.793225 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 42/77] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:35 2022] GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4 => generated 1368 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:44:36.827254 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-f4287361-8b0c-4646-bac7-84af1995009e tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:36.828942 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-f4287361-8b0c-4646-bac7-84af1995009e tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:37.192757 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-f4287361-8b0c-4646-bac7-84af1995009e tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:37.203850 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-f4287361-8b0c-4646-bac7-84af1995009e tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 200 len: 1238 microversion: 2.1 time: 0.395072 Jun 23 11:44:37.209993 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 43/78] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:36 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 1238 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:44:37.291194 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-03f8c1b9-2436-42b8-ad9f-b0713d24b1e5 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae72d6c494ba4f16989adfe090803d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515e65a705ee46cc8f8e03efbe58f177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:37.301391 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-03f8c1b9-2436-42b8-ad9f-b0713d24b1e5 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] 10.222.0.13 "GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d" status: 200 len: 1314 microversion: 2.1 time: 0.975448 Jun 23 11:44:37.316169 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 36/79] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:36 2022] GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d => generated 1314 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:44:37.339136 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-02e0f683-2893-489a-8b6c-ab63df92caa4 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:37.339884 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-02e0f683-2893-489a-8b6c-ab63df92caa4 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 0953fa06-0916-418f-b527-06d088cc6066] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:37.367207 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-02e0f683-2893-489a-8b6c-ab63df92caa4 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:37.367971 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-02e0f683-2893-489a-8b6c-ab63df92caa4 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:37.369409 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-02e0f683-2893-489a-8b6c-ab63df92caa4 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:37.370264 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-02e0f683-2893-489a-8b6c-ab63df92caa4 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:37.751758 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [req-658b9013-81b7-42b4-ac21-86c8a3bbc290 req-cdccca11-ee48-46b4-b80c-8ded4ef3fa1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "762e880e-7ec3-41bb-aac7-fa05de4efd11", "tag": "6fce142e-835a-4a3c-9803-6bb673a86c29"}]} {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:44:37.798804 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-658b9013-81b7-42b4-ac21-86c8a3bbc290 req-cdccca11-ee48-46b4-b80c-8ded4ef3fa1a service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:37.799278 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-658b9013-81b7-42b4-ac21-86c8a3bbc290 req-cdccca11-ee48-46b4-b80c-8ded4ef3fa1a service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:37.846999 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-02e0f683-2893-489a-8b6c-ab63df92caa4 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:37.858249 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-02e0f683-2893-489a-8b6c-ab63df92caa4 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066" status: 200 len: 1322 microversion: 2.1 time: 0.535932 Jun 23 11:44:37.860249 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 37/80] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:37 2022] GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066 => generated 1322 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:44:37.871352 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-ca3b9297-66ba-4d23-a0dc-348fb2b2b588 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:37.872188 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-ca3b9297-66ba-4d23-a0dc-348fb2b2b588 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 250e2ce6-70ad-4082-8073-6a9cea0ca1e4] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:37.880367 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ca3b9297-66ba-4d23-a0dc-348fb2b2b588 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:37.881107 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ca3b9297-66ba-4d23-a0dc-348fb2b2b588 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:37.882159 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ca3b9297-66ba-4d23-a0dc-348fb2b2b588 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:37.883141 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ca3b9297-66ba-4d23-a0dc-348fb2b2b588 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:37.902307 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.compute.server_external_events [req-658b9013-81b7-42b4-ac21-86c8a3bbc290 req-cdccca11-ee48-46b4-b80c-8ded4ef3fa1a service nova] Creating event network-changed:6fce142e-835a-4a3c-9803-6bb673a86c29 for instance 762e880e-7ec3-41bb-aac7-fa05de4efd11 on hv-cinder-82099 Jun 23 11:44:37.906248 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-658b9013-81b7-42b4-ac21-86c8a3bbc290 req-cdccca11-ee48-46b4-b80c-8ded4ef3fa1a service nova] Acquired lock "compute-rpcapi-router" {{(pid=124670) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 23 11:44:37.912612 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1d053985-44fc-4434-a902-9e1637842675 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:37.913808 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1d053985-44fc-4434-a902-9e1637842675 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:37.914801 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1d053985-44fc-4434-a902-9e1637842675 None None] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:37.915254 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1d053985-44fc-4434-a902-9e1637842675 None None] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:37.965454 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.compute.rpcapi [None req-1d053985-44fc-4434-a902-9e1637842675 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 23 11:44:37.969318 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1d053985-44fc-4434-a902-9e1637842675 None None] Releasing lock "compute-rpcapi-router" {{(pid=124670) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 23 11:44:38.009193 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-1d053985-44fc-4434-a902-9e1637842675 None None] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.796700 Jun 23 11:44:38.010016 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 44/81] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:44:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:44:38.227696 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-ca3b9297-66ba-4d23-a0dc-348fb2b2b588 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:38.228720 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-9e33aa29-33c3-4f9d-981c-4d4e4c810cc2 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:38.229448 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-9e33aa29-33c3-4f9d-981c-4d4e4c810cc2 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:38.237984 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-ca3b9297-66ba-4d23-a0dc-348fb2b2b588 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4" status: 200 len: 1368 microversion: 2.1 time: 0.375582 Jun 23 11:44:38.238969 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 38/82] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:37 2022] GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4 => generated 1368 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:44:38.245999 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-9e33aa29-33c3-4f9d-981c-4d4e4c810cc2 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:38.246601 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-9e33aa29-33c3-4f9d-981c-4d4e4c810cc2 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:38.248904 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-9e33aa29-33c3-4f9d-981c-4d4e4c810cc2 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:38.250191 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-9e33aa29-33c3-4f9d-981c-4d4e4c810cc2 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:38.321994 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-d4b98c6f-64ab-4de5-a440-77075ed62612 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:38.323571 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-d4b98c6f-64ab-4de5-a440-77075ed62612 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] [instance: 16a06134-ea93-492f-a705-29cc31876c5d] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:38.346662 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-d4b98c6f-64ab-4de5-a440-77075ed62612 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:38.347561 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-d4b98c6f-64ab-4de5-a440-77075ed62612 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:38.349885 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-d4b98c6f-64ab-4de5-a440-77075ed62612 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:38.353593 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-d4b98c6f-64ab-4de5-a440-77075ed62612 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:38.525047 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-9e33aa29-33c3-4f9d-981c-4d4e4c810cc2 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:38.535237 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-9e33aa29-33c3-4f9d-981c-4d4e4c810cc2 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 200 len: 1242 microversion: 2.1 time: 0.311660 Jun 23 11:44:38.539678 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 45/83] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:38 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 1242 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:44:38.855682 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-d4b98c6f-64ab-4de5-a440-77075ed62612 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae72d6c494ba4f16989adfe090803d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515e65a705ee46cc8f8e03efbe58f177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:38.864172 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-d4b98c6f-64ab-4de5-a440-77075ed62612 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] 10.222.0.13 "GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d" status: 200 len: 1314 microversion: 2.1 time: 0.548599 Jun 23 11:44:38.875514 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 39/84] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:38 2022] GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d => generated 1314 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:44:38.877641 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-5548a12f-53b9-4452-84ef-bfe56db45048 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:38.878411 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-5548a12f-53b9-4452-84ef-bfe56db45048 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 0953fa06-0916-418f-b527-06d088cc6066] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:38.890405 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-5548a12f-53b9-4452-84ef-bfe56db45048 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:38.893325 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-5548a12f-53b9-4452-84ef-bfe56db45048 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:38.895418 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-5548a12f-53b9-4452-84ef-bfe56db45048 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:38.897097 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-5548a12f-53b9-4452-84ef-bfe56db45048 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:39.361667 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-5548a12f-53b9-4452-84ef-bfe56db45048 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:39.375508 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-5548a12f-53b9-4452-84ef-bfe56db45048 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066" status: 200 len: 1322 microversion: 2.1 time: 0.501522 Jun 23 11:44:39.376265 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 46/85] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:38 2022] GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066 => generated 1322 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:44:39.387957 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-97af7741-b8ce-4c49-ae4a-9738e9bfd5b3 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:39.392917 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-97af7741-b8ce-4c49-ae4a-9738e9bfd5b3 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 250e2ce6-70ad-4082-8073-6a9cea0ca1e4] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:39.410059 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-97af7741-b8ce-4c49-ae4a-9738e9bfd5b3 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:39.412570 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-97af7741-b8ce-4c49-ae4a-9738e9bfd5b3 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:39.414759 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-97af7741-b8ce-4c49-ae4a-9738e9bfd5b3 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:39.418028 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-97af7741-b8ce-4c49-ae4a-9738e9bfd5b3 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:39.430627 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_cell1:SELECT=100 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:39.458164 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [req-17eded74-55eb-4046-8afc-deaf81759519 req-cb10e8a5-ad2e-4058-a22c-910f1a974c27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "250e2ce6-70ad-4082-8073-6a9cea0ca1e4", "tag": "acf9b9ee-0912-476a-bbae-a8fa23161cdb"}]} {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:44:39.487656 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [req-17eded74-55eb-4046-8afc-deaf81759519 req-cb10e8a5-ad2e-4058-a22c-910f1a974c27 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:39.488469 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [req-17eded74-55eb-4046-8afc-deaf81759519 req-cb10e8a5-ad2e-4058-a22c-910f1a974c27 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:39.547005 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.compute.server_external_events [req-17eded74-55eb-4046-8afc-deaf81759519 req-cb10e8a5-ad2e-4058-a22c-910f1a974c27 service nova] Creating event network-changed:acf9b9ee-0912-476a-bbae-a8fa23161cdb for instance 250e2ce6-70ad-4082-8073-6a9cea0ca1e4 on hv-cinder-82099 Jun 23 11:44:39.547835 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [req-17eded74-55eb-4046-8afc-deaf81759519 req-cb10e8a5-ad2e-4058-a22c-910f1a974c27 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124669) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 23 11:44:39.549322 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-47491801-9d76-47ce-88b7-b2aa9f5d3a9a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:39.550110 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-47491801-9d76-47ce-88b7-b2aa9f5d3a9a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:39.551466 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-47491801-9d76-47ce-88b7-b2aa9f5d3a9a None None] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:39.552328 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-47491801-9d76-47ce-88b7-b2aa9f5d3a9a None None] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:39.563531 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.compute.rpcapi [None req-47491801-9d76-47ce-88b7-b2aa9f5d3a9a None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 23 11:44:39.564849 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-47491801-9d76-47ce-88b7-b2aa9f5d3a9a None None] Releasing lock "compute-rpcapi-router" {{(pid=124669) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 23 11:44:39.607590 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-47491801-9d76-47ce-88b7-b2aa9f5d3a9a None None] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.371998 Jun 23 11:44:39.609166 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 40/86] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:44:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:44:39.615820 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-fced0607-c822-4f77-b3f0-a799f9cbf5cf tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:39.623838 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-fced0607-c822-4f77-b3f0-a799f9cbf5cf tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:39.640300 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-fced0607-c822-4f77-b3f0-a799f9cbf5cf tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:39.641793 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-fced0607-c822-4f77-b3f0-a799f9cbf5cf tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:39.645920 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-fced0607-c822-4f77-b3f0-a799f9cbf5cf tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:39.647233 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-fced0607-c822-4f77-b3f0-a799f9cbf5cf tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:40.354955 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-fced0607-c822-4f77-b3f0-a799f9cbf5cf tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:40.398165 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-fced0607-c822-4f77-b3f0-a799f9cbf5cf tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 200 len: 1290 microversion: 2.1 time: 0.787408 Jun 23 11:44:40.398812 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 41/87] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:39 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 1290 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:44:40.424456 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-16154084-5674-4f34-8ad2-6275af84fcc3 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:40.425428 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-16154084-5674-4f34-8ad2-6275af84fcc3 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] [instance: 16a06134-ea93-492f-a705-29cc31876c5d] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:40.440226 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-16154084-5674-4f34-8ad2-6275af84fcc3 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:40.456908 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-16154084-5674-4f34-8ad2-6275af84fcc3 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:40.458814 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-16154084-5674-4f34-8ad2-6275af84fcc3 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:40.458814 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-16154084-5674-4f34-8ad2-6275af84fcc3 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:40.942167 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-97af7741-b8ce-4c49-ae4a-9738e9bfd5b3 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:40.965063 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-97af7741-b8ce-4c49-ae4a-9738e9bfd5b3 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4" status: 200 len: 1368 microversion: 2.1 time: 1.587426 Jun 23 11:44:40.974374 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 47/88] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:39 2022] GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4 => generated 1368 bytes in 1597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:44:40.982897 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [req-3a33f86a-73d5-4ff5-a574-efa83f613c9d req-7012e956-a06c-4143-ba0f-54747cfed604 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0953fa06-0916-418f-b527-06d088cc6066", "tag": "56dc5915-6e20-441e-8915-6463dfb576ba"}, {"name": "network-changed", "server_uuid": "16a06134-ea93-492f-a705-29cc31876c5d", "tag": "66ff8d4e-945d-42bc-b261-4309e6e07015"}]} {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:44:41.028422 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-3a33f86a-73d5-4ff5-a574-efa83f613c9d req-7012e956-a06c-4143-ba0f-54747cfed604 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:41.035059 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-3a33f86a-73d5-4ff5-a574-efa83f613c9d req-7012e956-a06c-4143-ba0f-54747cfed604 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:41.050446 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.compute.server_external_events [req-3a33f86a-73d5-4ff5-a574-efa83f613c9d req-7012e956-a06c-4143-ba0f-54747cfed604 service nova] Creating event network-changed:56dc5915-6e20-441e-8915-6463dfb576ba for instance 0953fa06-0916-418f-b527-06d088cc6066 on hv-cinder-82099 Jun 23 11:44:41.051265 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.compute.server_external_events [req-3a33f86a-73d5-4ff5-a574-efa83f613c9d req-7012e956-a06c-4143-ba0f-54747cfed604 service nova] Creating event network-changed:66ff8d4e-945d-42bc-b261-4309e6e07015 for instance 16a06134-ea93-492f-a705-29cc31876c5d on hv-cinder-82099 Jun 23 11:44:41.061990 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [req-3a33f86a-73d5-4ff5-a574-efa83f613c9d req-7012e956-a06c-4143-ba0f-54747cfed604 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.085976 Jun 23 11:44:41.070134 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 48/89] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:44:40 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:44:41.072353 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-b21d4733-96c1-4f33-8a0d-4e75d69085dc tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:41.073280 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-b21d4733-96c1-4f33-8a0d-4e75d69085dc tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 0953fa06-0916-418f-b527-06d088cc6066] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:41.099540 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-b21d4733-96c1-4f33-8a0d-4e75d69085dc tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:41.099540 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-b21d4733-96c1-4f33-8a0d-4e75d69085dc tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:41.099540 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-b21d4733-96c1-4f33-8a0d-4e75d69085dc tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:41.099540 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-b21d4733-96c1-4f33-8a0d-4e75d69085dc tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:41.310006 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-16154084-5674-4f34-8ad2-6275af84fcc3 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae72d6c494ba4f16989adfe090803d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515e65a705ee46cc8f8e03efbe58f177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:41.320764 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-16154084-5674-4f34-8ad2-6275af84fcc3 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] 10.222.0.13 "GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d" status: 200 len: 1314 microversion: 2.1 time: 0.920529 Jun 23 11:44:41.325380 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 42/90] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:40 2022] GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d => generated 1314 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:44:41.422039 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-c763be6f-6d6f-4216-99e9-311baa63798b tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:41.422996 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-c763be6f-6d6f-4216-99e9-311baa63798b tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:41.457285 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c763be6f-6d6f-4216-99e9-311baa63798b tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:41.457285 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c763be6f-6d6f-4216-99e9-311baa63798b tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:41.457734 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c763be6f-6d6f-4216-99e9-311baa63798b tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:41.458179 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c763be6f-6d6f-4216-99e9-311baa63798b tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:41.656081 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-c763be6f-6d6f-4216-99e9-311baa63798b tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:41.672354 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_cell1:SELECT=99 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:41.675234 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-c763be6f-6d6f-4216-99e9-311baa63798b tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 200 len: 1296 microversion: 2.1 time: 0.260773 Jun 23 11:44:41.678653 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 43/91] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:41 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 1296 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:44:41.777012 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-b21d4733-96c1-4f33-8a0d-4e75d69085dc tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:41.790128 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-b21d4733-96c1-4f33-8a0d-4e75d69085dc tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066" status: 200 len: 1322 microversion: 2.1 time: 0.724739 Jun 23 11:44:41.793623 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 49/92] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:41 2022] GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066 => generated 1322 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:44:41.989948 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-f9fb2aec-3252-4979-8750-b00226a13a7d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:41.990857 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-f9fb2aec-3252-4979-8750-b00226a13a7d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 250e2ce6-70ad-4082-8073-6a9cea0ca1e4] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:41.994156 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=9 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:42.010308 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-f9fb2aec-3252-4979-8750-b00226a13a7d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:42.011011 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-f9fb2aec-3252-4979-8750-b00226a13a7d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:42.012763 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-f9fb2aec-3252-4979-8750-b00226a13a7d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:42.013399 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-f9fb2aec-3252-4979-8750-b00226a13a7d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:42.337212 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-f9fb2aec-3252-4979-8750-b00226a13a7d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:42.346751 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-5ec5c0c9-05b0-44cd-9c94-5476c6055280 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:42.348074 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-5ec5c0c9-05b0-44cd-9c94-5476c6055280 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] [instance: 16a06134-ea93-492f-a705-29cc31876c5d] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:42.352272 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-f9fb2aec-3252-4979-8750-b00226a13a7d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4" status: 200 len: 1368 microversion: 2.1 time: 0.366824 Jun 23 11:44:42.352873 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 44/93] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:41 2022] GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4 => generated 1368 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:44:42.363876 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-5ec5c0c9-05b0-44cd-9c94-5476c6055280 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:42.364477 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-5ec5c0c9-05b0-44cd-9c94-5476c6055280 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:42.365446 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-5ec5c0c9-05b0-44cd-9c94-5476c6055280 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:42.366063 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-5ec5c0c9-05b0-44cd-9c94-5476c6055280 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:42.512243 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-5ec5c0c9-05b0-44cd-9c94-5476c6055280 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae72d6c494ba4f16989adfe090803d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515e65a705ee46cc8f8e03efbe58f177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:42.520780 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-5ec5c0c9-05b0-44cd-9c94-5476c6055280 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] 10.222.0.13 "GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d" status: 200 len: 1314 microversion: 2.1 time: 0.180033 Jun 23 11:44:42.521346 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 50/94] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:42 2022] GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:44:42.693284 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-b727d4c5-06f2-4a7b-bdc2-bda90716e3ff tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:42.694824 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-b727d4c5-06f2-4a7b-bdc2-bda90716e3ff tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:42.703000 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-b727d4c5-06f2-4a7b-bdc2-bda90716e3ff tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:42.703503 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-b727d4c5-06f2-4a7b-bdc2-bda90716e3ff tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:42.704456 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-b727d4c5-06f2-4a7b-bdc2-bda90716e3ff tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:42.704892 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-b727d4c5-06f2-4a7b-bdc2-bda90716e3ff tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:42.811542 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-1458416e-0192-4e28-befd-e08ea8d3e889 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:42.812209 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-1458416e-0192-4e28-befd-e08ea8d3e889 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 0953fa06-0916-418f-b527-06d088cc6066] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:42.818488 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-b727d4c5-06f2-4a7b-bdc2-bda90716e3ff tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:42.821624 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1458416e-0192-4e28-befd-e08ea8d3e889 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:42.821624 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1458416e-0192-4e28-befd-e08ea8d3e889 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:42.821624 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1458416e-0192-4e28-befd-e08ea8d3e889 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:42.821624 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1458416e-0192-4e28-befd-e08ea8d3e889 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:42.829006 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-b727d4c5-06f2-4a7b-bdc2-bda90716e3ff tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 200 len: 1296 microversion: 2.1 time: 0.139591 Jun 23 11:44:42.830078 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 45/95] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:42 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 1296 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:44:43.007646 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-1458416e-0192-4e28-befd-e08ea8d3e889 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:43.017001 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-1458416e-0192-4e28-befd-e08ea8d3e889 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066" status: 200 len: 1322 microversion: 2.1 time: 0.209690 Jun 23 11:44:43.021660 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 51/96] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:42 2022] GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066 => generated 1322 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:44:43.370426 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-ad799c85-10c8-4bba-8a4c-a2be38cb7808 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:43.377994 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-ad799c85-10c8-4bba-8a4c-a2be38cb7808 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 250e2ce6-70ad-4082-8073-6a9cea0ca1e4] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:43.378628 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ad799c85-10c8-4bba-8a4c-a2be38cb7808 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:43.379485 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ad799c85-10c8-4bba-8a4c-a2be38cb7808 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:43.380484 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ad799c85-10c8-4bba-8a4c-a2be38cb7808 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:43.381119 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ad799c85-10c8-4bba-8a4c-a2be38cb7808 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:43.525663 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-ad799c85-10c8-4bba-8a4c-a2be38cb7808 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:43.534483 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-ad799c85-10c8-4bba-8a4c-a2be38cb7808 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4" status: 200 len: 1368 microversion: 2.1 time: 0.169026 Jun 23 11:44:43.535201 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 46/97] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:43 2022] GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4 => generated 1368 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:44:43.537090 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-7a89c1ac-5d49-4477-ad6e-38ea56b7eed3 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:43.537706 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-7a89c1ac-5d49-4477-ad6e-38ea56b7eed3 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] [instance: 16a06134-ea93-492f-a705-29cc31876c5d] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:43.547421 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-7a89c1ac-5d49-4477-ad6e-38ea56b7eed3 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:43.547988 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-7a89c1ac-5d49-4477-ad6e-38ea56b7eed3 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:43.548865 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-7a89c1ac-5d49-4477-ad6e-38ea56b7eed3 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:43.549315 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-7a89c1ac-5d49-4477-ad6e-38ea56b7eed3 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:43.846996 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-ca72e01b-7cfe-4b15-874c-cdcfdb32677c tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:43.847611 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-ca72e01b-7cfe-4b15-874c-cdcfdb32677c tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:43.853855 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ca72e01b-7cfe-4b15-874c-cdcfdb32677c tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:43.854306 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ca72e01b-7cfe-4b15-874c-cdcfdb32677c tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:43.855135 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ca72e01b-7cfe-4b15-874c-cdcfdb32677c tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:43.855736 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ca72e01b-7cfe-4b15-874c-cdcfdb32677c tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:43.869368 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-7a89c1ac-5d49-4477-ad6e-38ea56b7eed3 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae72d6c494ba4f16989adfe090803d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515e65a705ee46cc8f8e03efbe58f177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:43.883553 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-7a89c1ac-5d49-4477-ad6e-38ea56b7eed3 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] 10.222.0.13 "GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d" status: 200 len: 1314 microversion: 2.1 time: 0.350118 Jun 23 11:44:43.884251 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 52/98] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:43 2022] GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d => generated 1314 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:44:44.035979 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-3a1d80f2-8dde-41dc-9ccb-4ef8d1d2b843 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:44.036837 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-3a1d80f2-8dde-41dc-9ccb-4ef8d1d2b843 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 0953fa06-0916-418f-b527-06d088cc6066] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:44.043136 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-3a1d80f2-8dde-41dc-9ccb-4ef8d1d2b843 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:44.043587 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-3a1d80f2-8dde-41dc-9ccb-4ef8d1d2b843 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:44.045094 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-3a1d80f2-8dde-41dc-9ccb-4ef8d1d2b843 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:44.045538 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-3a1d80f2-8dde-41dc-9ccb-4ef8d1d2b843 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:44.427496 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-ca72e01b-7cfe-4b15-874c-cdcfdb32677c tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:44.448080 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-ca72e01b-7cfe-4b15-874c-cdcfdb32677c tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 200 len: 1364 microversion: 2.1 time: 0.594071 Jun 23 11:44:44.448080 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 47/99] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:43 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 1364 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:44:44.472354 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-3a1d80f2-8dde-41dc-9ccb-4ef8d1d2b843 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:44.481516 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-3a1d80f2-8dde-41dc-9ccb-4ef8d1d2b843 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066" status: 200 len: 1322 microversion: 2.1 time: 0.449458 Jun 23 11:44:44.503799 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 53/100] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:44 2022] GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066 => generated 1322 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:44:44.552523 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-d357ffcd-24a9-4bb6-b6b0-2f689191916c tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:44.553223 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-d357ffcd-24a9-4bb6-b6b0-2f689191916c tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 250e2ce6-70ad-4082-8073-6a9cea0ca1e4] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:44.559355 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-d357ffcd-24a9-4bb6-b6b0-2f689191916c tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:44.559811 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-d357ffcd-24a9-4bb6-b6b0-2f689191916c tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:44.560725 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-d357ffcd-24a9-4bb6-b6b0-2f689191916c tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:44.561191 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-d357ffcd-24a9-4bb6-b6b0-2f689191916c tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:44.798155 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-d357ffcd-24a9-4bb6-b6b0-2f689191916c tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:44.811155 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-d357ffcd-24a9-4bb6-b6b0-2f689191916c tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4" status: 200 len: 1368 microversion: 2.1 time: 0.257775 Jun 23 11:44:44.816268 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 48/101] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:44 2022] GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4 => generated 1368 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:44:44.901518 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-434c2a6b-bd84-4347-acb3-0e4b75b3911f tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:44.902414 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-434c2a6b-bd84-4347-acb3-0e4b75b3911f tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] [instance: 16a06134-ea93-492f-a705-29cc31876c5d] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:44.910070 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-434c2a6b-bd84-4347-acb3-0e4b75b3911f tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:44.910598 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-434c2a6b-bd84-4347-acb3-0e4b75b3911f tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:44.911393 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-434c2a6b-bd84-4347-acb3-0e4b75b3911f tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:44.911858 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-434c2a6b-bd84-4347-acb3-0e4b75b3911f tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:45.064431 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [req-ad4c79f4-50ed-4a92-8bbf-843492b75249 req-d96a6561-139f-4595-8496-ec3540d8cbc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46d9d467-7a71-4e30-af82-629121319200", "tag": "0a894540-735d-4ac5-8343-16862b680cd3"}]} {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:44:45.072823 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [req-ad4c79f4-50ed-4a92-8bbf-843492b75249 req-d96a6561-139f-4595-8496-ec3540d8cbc9 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:45.073267 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [req-ad4c79f4-50ed-4a92-8bbf-843492b75249 req-d96a6561-139f-4595-8496-ec3540d8cbc9 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:45.092227 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.compute.server_external_events [req-ad4c79f4-50ed-4a92-8bbf-843492b75249 req-d96a6561-139f-4595-8496-ec3540d8cbc9 service nova] Creating event network-changed:0a894540-735d-4ac5-8343-16862b680cd3 for instance 46d9d467-7a71-4e30-af82-629121319200 on hv-cinder-82099 Jun 23 11:44:45.096354 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [req-ad4c79f4-50ed-4a92-8bbf-843492b75249 req-d96a6561-139f-4595-8496-ec3540d8cbc9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036417 Jun 23 11:44:45.097517 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 49/102] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:44:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:44:45.142206 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-434c2a6b-bd84-4347-acb3-0e4b75b3911f tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae72d6c494ba4f16989adfe090803d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515e65a705ee46cc8f8e03efbe58f177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:45.152020 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-434c2a6b-bd84-4347-acb3-0e4b75b3911f tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] 10.222.0.13 "GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d" status: 200 len: 1314 microversion: 2.1 time: 0.254579 Jun 23 11:44:45.152598 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 54/103] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:44 2022] GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:44:45.463383 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-f16cd0cd-1a5e-4bda-8375-bedcad58c5a9 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:45.469380 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-f16cd0cd-1a5e-4bda-8375-bedcad58c5a9 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:45.471532 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-f16cd0cd-1a5e-4bda-8375-bedcad58c5a9 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:45.471991 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-f16cd0cd-1a5e-4bda-8375-bedcad58c5a9 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:45.472784 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-f16cd0cd-1a5e-4bda-8375-bedcad58c5a9 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:45.473248 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-f16cd0cd-1a5e-4bda-8375-bedcad58c5a9 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:45.519567 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-d7e27a4b-40b5-479a-a2dc-e6b092d01759 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:45.520406 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-d7e27a4b-40b5-479a-a2dc-e6b092d01759 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 0953fa06-0916-418f-b527-06d088cc6066] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:45.526972 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-d7e27a4b-40b5-479a-a2dc-e6b092d01759 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:45.527589 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-d7e27a4b-40b5-479a-a2dc-e6b092d01759 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:45.528409 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-d7e27a4b-40b5-479a-a2dc-e6b092d01759 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:45.529421 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-d7e27a4b-40b5-479a-a2dc-e6b092d01759 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:45.686335 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-f16cd0cd-1a5e-4bda-8375-bedcad58c5a9 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:45.697299 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-f16cd0cd-1a5e-4bda-8375-bedcad58c5a9 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 200 len: 1364 microversion: 2.1 time: 0.238230 Jun 23 11:44:45.698650 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 50/104] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:45 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 1364 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:44:45.715009 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-d7e27a4b-40b5-479a-a2dc-e6b092d01759 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:45.724124 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-d7e27a4b-40b5-479a-a2dc-e6b092d01759 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066" status: 200 len: 1322 microversion: 2.1 time: 0.215166 Jun 23 11:44:45.724904 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 55/105] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:45 2022] GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066 => generated 1322 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:44:45.824194 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-cd7c645d-3f97-4cc9-8140-daa08f5b1a76 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:45.824868 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-cd7c645d-3f97-4cc9-8140-daa08f5b1a76 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 250e2ce6-70ad-4082-8073-6a9cea0ca1e4] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:45.831608 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-cd7c645d-3f97-4cc9-8140-daa08f5b1a76 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:45.832055 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-cd7c645d-3f97-4cc9-8140-daa08f5b1a76 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:45.832851 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-cd7c645d-3f97-4cc9-8140-daa08f5b1a76 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:45.833496 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-cd7c645d-3f97-4cc9-8140-daa08f5b1a76 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:45.964410 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-cd7c645d-3f97-4cc9-8140-daa08f5b1a76 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:45.972501 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-cd7c645d-3f97-4cc9-8140-daa08f5b1a76 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4" status: 200 len: 1368 microversion: 2.1 time: 0.153247 Jun 23 11:44:45.973074 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 51/106] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:45 2022] GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:44:46.174142 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-441e9121-2fff-4cee-b57f-6c8349037f8a tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:46.174142 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-441e9121-2fff-4cee-b57f-6c8349037f8a tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] [instance: 16a06134-ea93-492f-a705-29cc31876c5d] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:46.180163 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-441e9121-2fff-4cee-b57f-6c8349037f8a tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:46.180715 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-441e9121-2fff-4cee-b57f-6c8349037f8a tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:46.181656 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-441e9121-2fff-4cee-b57f-6c8349037f8a tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:46.182281 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-441e9121-2fff-4cee-b57f-6c8349037f8a tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:46.322151 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-441e9121-2fff-4cee-b57f-6c8349037f8a tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae72d6c494ba4f16989adfe090803d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515e65a705ee46cc8f8e03efbe58f177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:46.329709 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-441e9121-2fff-4cee-b57f-6c8349037f8a tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] 10.222.0.13 "GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d" status: 200 len: 1314 microversion: 2.1 time: 0.164239 Jun 23 11:44:46.330272 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 56/107] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:46 2022] GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:44:46.715746 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-9ebc4413-1774-46d9-abef-7622fe10609e tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:46.716852 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-9ebc4413-1774-46d9-abef-7622fe10609e tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:46.718770 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_cell0:SELECT=6 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:46.723683 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-9ebc4413-1774-46d9-abef-7622fe10609e tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:46.724135 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-9ebc4413-1774-46d9-abef-7622fe10609e tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:46.724894 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-9ebc4413-1774-46d9-abef-7622fe10609e tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:46.725331 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-9ebc4413-1774-46d9-abef-7622fe10609e tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:46.741205 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-476745e5-0205-46e7-9588-4e2d21185525 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:46.741858 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-476745e5-0205-46e7-9588-4e2d21185525 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 0953fa06-0916-418f-b527-06d088cc6066] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:46.747949 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-476745e5-0205-46e7-9588-4e2d21185525 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:46.748510 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-476745e5-0205-46e7-9588-4e2d21185525 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:46.749305 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-476745e5-0205-46e7-9588-4e2d21185525 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:46.749777 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-476745e5-0205-46e7-9588-4e2d21185525 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:46.910247 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-9ebc4413-1774-46d9-abef-7622fe10609e tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:46.917574 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-9ebc4413-1774-46d9-abef-7622fe10609e tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 200 len: 1364 microversion: 2.1 time: 0.205678 Jun 23 11:44:46.918145 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 52/108] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:46 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 1364 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:44:46.925222 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-476745e5-0205-46e7-9588-4e2d21185525 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:46.932631 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-476745e5-0205-46e7-9588-4e2d21185525 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066" status: 200 len: 1322 microversion: 2.1 time: 0.195439 Jun 23 11:44:46.933196 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 57/109] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:46 2022] GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066 => generated 1322 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:44:46.989429 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-7f53913a-5f5a-4793-9280-8a8f4c90a7ed tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:46.990042 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-7f53913a-5f5a-4793-9280-8a8f4c90a7ed tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 250e2ce6-70ad-4082-8073-6a9cea0ca1e4] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:46.996180 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-7f53913a-5f5a-4793-9280-8a8f4c90a7ed tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:46.996661 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-7f53913a-5f5a-4793-9280-8a8f4c90a7ed tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:46.997483 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-7f53913a-5f5a-4793-9280-8a8f4c90a7ed tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:46.997919 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-7f53913a-5f5a-4793-9280-8a8f4c90a7ed tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:47.129115 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-7f53913a-5f5a-4793-9280-8a8f4c90a7ed tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:47.136468 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-7f53913a-5f5a-4793-9280-8a8f4c90a7ed tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4" status: 200 len: 1368 microversion: 2.1 time: 0.150892 Jun 23 11:44:47.137030 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 53/110] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:46 2022] GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:44:47.347119 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-0c2729f4-9810-4fa7-91e4-6748e66e7bd7 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:47.347725 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-0c2729f4-9810-4fa7-91e4-6748e66e7bd7 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] [instance: 16a06134-ea93-492f-a705-29cc31876c5d] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:47.349668 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_cell0:SELECT=2 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:47.354570 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-0c2729f4-9810-4fa7-91e4-6748e66e7bd7 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:47.355094 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-0c2729f4-9810-4fa7-91e4-6748e66e7bd7 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:47.356088 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-0c2729f4-9810-4fa7-91e4-6748e66e7bd7 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:47.356622 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-0c2729f4-9810-4fa7-91e4-6748e66e7bd7 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:47.496520 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-0c2729f4-9810-4fa7-91e4-6748e66e7bd7 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae72d6c494ba4f16989adfe090803d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515e65a705ee46cc8f8e03efbe58f177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:47.505205 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-0c2729f4-9810-4fa7-91e4-6748e66e7bd7 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] 10.222.0.13 "GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d" status: 200 len: 1314 microversion: 2.1 time: 0.161998 Jun 23 11:44:47.505768 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 58/111] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:47 2022] GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:44:47.936467 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-c0486a6d-2c54-4787-acff-4c08ebb490cd tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:47.937076 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-c0486a6d-2c54-4787-acff-4c08ebb490cd tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:47.950668 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-e530d41d-300a-4c58-b57d-b224153784e0 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:47.951352 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-e530d41d-300a-4c58-b57d-b224153784e0 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 0953fa06-0916-418f-b527-06d088cc6066] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:47.953507 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c0486a6d-2c54-4787-acff-4c08ebb490cd tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:47.953992 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c0486a6d-2c54-4787-acff-4c08ebb490cd tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:47.954890 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c0486a6d-2c54-4787-acff-4c08ebb490cd tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:47.955326 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c0486a6d-2c54-4787-acff-4c08ebb490cd tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:47.958209 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-e530d41d-300a-4c58-b57d-b224153784e0 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:47.958785 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-e530d41d-300a-4c58-b57d-b224153784e0 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:47.959891 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-e530d41d-300a-4c58-b57d-b224153784e0 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:47.960325 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-e530d41d-300a-4c58-b57d-b224153784e0 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:47.960765 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_cell0:SELECT=2 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:48.171385 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-c0486a6d-2c54-4787-acff-4c08ebb490cd tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:48.179236 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-c0486a6d-2c54-4787-acff-4c08ebb490cd tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 200 len: 1364 microversion: 2.1 time: 0.247658 Jun 23 11:44:48.179367 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-e530d41d-300a-4c58-b57d-b224153784e0 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:48.180004 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 54/112] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:47 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 1364 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:44:48.188796 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-822c8c17-9f57-40b3-973b-4e4c5cbff74f tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:48.189740 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-822c8c17-9f57-40b3-973b-4e4c5cbff74f tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 250e2ce6-70ad-4082-8073-6a9cea0ca1e4] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:48.193207 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-e530d41d-300a-4c58-b57d-b224153784e0 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066" status: 200 len: 1322 microversion: 2.1 time: 0.247371 Jun 23 11:44:48.194002 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 59/113] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:47 2022] GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066 => generated 1322 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:44:48.196112 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-822c8c17-9f57-40b3-973b-4e4c5cbff74f tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:48.196626 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-822c8c17-9f57-40b3-973b-4e4c5cbff74f tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:48.197385 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-822c8c17-9f57-40b3-973b-4e4c5cbff74f tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:48.197815 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-822c8c17-9f57-40b3-973b-4e4c5cbff74f tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:48.335420 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-822c8c17-9f57-40b3-973b-4e4c5cbff74f tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:48.343902 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-822c8c17-9f57-40b3-973b-4e4c5cbff74f tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4" status: 200 len: 1368 microversion: 2.1 time: 0.163159 Jun 23 11:44:48.344475 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 55/114] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:48 2022] GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4 => generated 1368 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:44:48.533592 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-491393e9-fc1f-45d4-bd7d-365c75aac422 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:48.533592 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-491393e9-fc1f-45d4-bd7d-365c75aac422 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] [instance: 16a06134-ea93-492f-a705-29cc31876c5d] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:48.533592 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-491393e9-fc1f-45d4-bd7d-365c75aac422 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:48.533592 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-491393e9-fc1f-45d4-bd7d-365c75aac422 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:48.534267 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-491393e9-fc1f-45d4-bd7d-365c75aac422 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:48.534267 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-491393e9-fc1f-45d4-bd7d-365c75aac422 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:48.682195 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-491393e9-fc1f-45d4-bd7d-365c75aac422 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae72d6c494ba4f16989adfe090803d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515e65a705ee46cc8f8e03efbe58f177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:48.690322 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-491393e9-fc1f-45d4-bd7d-365c75aac422 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] 10.222.0.13 "GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d" status: 200 len: 1314 microversion: 2.1 time: 0.171738 Jun 23 11:44:48.690941 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 60/115] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:48 2022] GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:44:49.197320 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-02d699d5-b46f-4d7d-a377-7170303aeb9d tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:49.197997 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-02d699d5-b46f-4d7d-a377-7170303aeb9d tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:49.205022 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-02d699d5-b46f-4d7d-a377-7170303aeb9d tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:49.205471 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-02d699d5-b46f-4d7d-a377-7170303aeb9d tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:49.206236 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-02d699d5-b46f-4d7d-a377-7170303aeb9d tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:49.206742 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-02d699d5-b46f-4d7d-a377-7170303aeb9d tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:49.209968 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-e260ea3f-aca7-4fb8-8b98-12ce96d070a2 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:49.210631 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-e260ea3f-aca7-4fb8-8b98-12ce96d070a2 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 0953fa06-0916-418f-b527-06d088cc6066] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:49.217664 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-e260ea3f-aca7-4fb8-8b98-12ce96d070a2 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:49.218103 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-e260ea3f-aca7-4fb8-8b98-12ce96d070a2 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:49.218894 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-e260ea3f-aca7-4fb8-8b98-12ce96d070a2 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:49.219322 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-e260ea3f-aca7-4fb8-8b98-12ce96d070a2 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:49.403283 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-02d699d5-b46f-4d7d-a377-7170303aeb9d tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:49.407110 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-e260ea3f-aca7-4fb8-8b98-12ce96d070a2 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:49.411293 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-02d699d5-b46f-4d7d-a377-7170303aeb9d tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 200 len: 1364 microversion: 2.1 time: 0.217849 Jun 23 11:44:49.411868 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 56/116] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:49 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 1364 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:44:49.414770 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-e260ea3f-aca7-4fb8-8b98-12ce96d070a2 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066" status: 200 len: 1322 microversion: 2.1 time: 0.209454 Jun 23 11:44:49.415315 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 61/117] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:49 2022] GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066 => generated 1322 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:44:49.416611 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-4a579acc-71d6-4a1e-b8fe-e5962661d078 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:49.417220 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-4a579acc-71d6-4a1e-b8fe-e5962661d078 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 250e2ce6-70ad-4082-8073-6a9cea0ca1e4] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:49.423909 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-4a579acc-71d6-4a1e-b8fe-e5962661d078 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:49.424527 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-4a579acc-71d6-4a1e-b8fe-e5962661d078 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:49.425437 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-4a579acc-71d6-4a1e-b8fe-e5962661d078 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:49.425877 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-4a579acc-71d6-4a1e-b8fe-e5962661d078 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:49.558114 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-4a579acc-71d6-4a1e-b8fe-e5962661d078 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:49.560912 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_cell0:SELECT=4 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:49.566820 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-4a579acc-71d6-4a1e-b8fe-e5962661d078 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4" status: 200 len: 1368 microversion: 2.1 time: 0.153888 Jun 23 11:44:49.567472 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 57/118] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:49 2022] GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:44:49.707693 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-1686e252-1ea3-42a9-9733-a02297828030 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:49.708312 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-1686e252-1ea3-42a9-9733-a02297828030 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] [instance: 16a06134-ea93-492f-a705-29cc31876c5d] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:49.714937 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1686e252-1ea3-42a9-9733-a02297828030 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:49.715384 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1686e252-1ea3-42a9-9733-a02297828030 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:49.716170 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1686e252-1ea3-42a9-9733-a02297828030 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:49.716598 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1686e252-1ea3-42a9-9733-a02297828030 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:49.843856 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-1686e252-1ea3-42a9-9733-a02297828030 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae72d6c494ba4f16989adfe090803d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515e65a705ee46cc8f8e03efbe58f177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:49.851486 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-1686e252-1ea3-42a9-9733-a02297828030 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] 10.222.0.13 "GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d" status: 200 len: 1314 microversion: 2.1 time: 0.147650 Jun 23 11:44:49.852050 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 62/119] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:49 2022] GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:44:50.431882 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-9ab65663-85b7-47cd-ba48-f32668c37feb tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:50.432409 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-7a2e8833-7ce3-43ec-8b59-d721e285ffd4 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:50.432530 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-7a2e8833-7ce3-43ec-8b59-d721e285ffd4 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:50.432616 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-9ab65663-85b7-47cd-ba48-f32668c37feb tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 0953fa06-0916-418f-b527-06d088cc6066] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:50.439247 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-9ab65663-85b7-47cd-ba48-f32668c37feb tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:50.439535 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-7a2e8833-7ce3-43ec-8b59-d721e285ffd4 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:50.439696 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-9ab65663-85b7-47cd-ba48-f32668c37feb tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:50.439991 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-7a2e8833-7ce3-43ec-8b59-d721e285ffd4 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:50.440460 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-9ab65663-85b7-47cd-ba48-f32668c37feb tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:50.440757 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-7a2e8833-7ce3-43ec-8b59-d721e285ffd4 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:50.440893 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-9ab65663-85b7-47cd-ba48-f32668c37feb tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:50.441197 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-7a2e8833-7ce3-43ec-8b59-d721e285ffd4 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:50.639265 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-7a2e8833-7ce3-43ec-8b59-d721e285ffd4 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:50.643606 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-9ab65663-85b7-47cd-ba48-f32668c37feb tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:50.647635 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-7a2e8833-7ce3-43ec-8b59-d721e285ffd4 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 200 len: 1364 microversion: 2.1 time: 0.219761 Jun 23 11:44:50.648488 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 63/120] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:50 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 1364 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:44:50.653424 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-faf86753-ac88-4154-842f-0f5812828bc9 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:50.654508 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-faf86753-ac88-4154-842f-0f5812828bc9 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 250e2ce6-70ad-4082-8073-6a9cea0ca1e4] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:50.660836 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-9ab65663-85b7-47cd-ba48-f32668c37feb tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066" status: 200 len: 1322 microversion: 2.1 time: 0.233024 Jun 23 11:44:50.660993 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-faf86753-ac88-4154-842f-0f5812828bc9 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:50.663259 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-faf86753-ac88-4154-842f-0f5812828bc9 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:50.663381 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 58/121] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:50 2022] GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066 => generated 1322 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:44:50.663466 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-faf86753-ac88-4154-842f-0f5812828bc9 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:50.663466 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-faf86753-ac88-4154-842f-0f5812828bc9 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:50.684554 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_cell1:SELECT=100 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:50.800018 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-faf86753-ac88-4154-842f-0f5812828bc9 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:50.807510 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-faf86753-ac88-4154-842f-0f5812828bc9 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4" status: 200 len: 1368 microversion: 2.1 time: 0.157771 Jun 23 11:44:50.808071 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 64/122] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:50 2022] GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:44:50.867915 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-30b5941c-c9c5-4b76-a802-2e3818c7a195 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:50.868640 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-30b5941c-c9c5-4b76-a802-2e3818c7a195 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] [instance: 16a06134-ea93-492f-a705-29cc31876c5d] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:50.874679 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-30b5941c-c9c5-4b76-a802-2e3818c7a195 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:50.875125 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-30b5941c-c9c5-4b76-a802-2e3818c7a195 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:50.875879 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-30b5941c-c9c5-4b76-a802-2e3818c7a195 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:50.876342 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-30b5941c-c9c5-4b76-a802-2e3818c7a195 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:51.006957 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-30b5941c-c9c5-4b76-a802-2e3818c7a195 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae72d6c494ba4f16989adfe090803d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515e65a705ee46cc8f8e03efbe58f177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:51.015248 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-30b5941c-c9c5-4b76-a802-2e3818c7a195 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] 10.222.0.13 "GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d" status: 200 len: 1314 microversion: 2.1 time: 0.151043 Jun 23 11:44:51.015838 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 59/123] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:50 2022] GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:44:51.664800 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-7507dc22-35d0-4b2e-85f8-d17dfa58ceb6 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:51.665502 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-7507dc22-35d0-4b2e-85f8-d17dfa58ceb6 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:51.673089 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-7507dc22-35d0-4b2e-85f8-d17dfa58ceb6 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:51.673633 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-7507dc22-35d0-4b2e-85f8-d17dfa58ceb6 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:51.674553 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-7507dc22-35d0-4b2e-85f8-d17dfa58ceb6 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:51.675036 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-7507dc22-35d0-4b2e-85f8-d17dfa58ceb6 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:51.682941 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-a32ecaae-1567-4352-b09f-ce603484d437 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:51.683629 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-a32ecaae-1567-4352-b09f-ce603484d437 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 0953fa06-0916-418f-b527-06d088cc6066] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:51.692358 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-a32ecaae-1567-4352-b09f-ce603484d437 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:51.692819 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-a32ecaae-1567-4352-b09f-ce603484d437 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:51.696490 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-a32ecaae-1567-4352-b09f-ce603484d437 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:51.696490 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-a32ecaae-1567-4352-b09f-ce603484d437 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:51.879584 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-7507dc22-35d0-4b2e-85f8-d17dfa58ceb6 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:51.889162 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-7507dc22-35d0-4b2e-85f8-d17dfa58ceb6 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 200 len: 1364 microversion: 2.1 time: 0.228380 Jun 23 11:44:51.889922 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-a32ecaae-1567-4352-b09f-ce603484d437 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:51.891534 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 65/124] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:51 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 1364 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:44:51.897531 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-a32ecaae-1567-4352-b09f-ce603484d437 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066" status: 200 len: 1322 microversion: 2.1 time: 0.222434 Jun 23 11:44:51.901629 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-4161ffb5-3f62-48e8-9786-0e756223d3e3 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:51.902228 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-4161ffb5-3f62-48e8-9786-0e756223d3e3 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 250e2ce6-70ad-4082-8073-6a9cea0ca1e4] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:51.906733 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 60/125] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:51 2022] GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066 => generated 1322 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:44:51.911731 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-4161ffb5-3f62-48e8-9786-0e756223d3e3 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:51.911731 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-4161ffb5-3f62-48e8-9786-0e756223d3e3 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:51.911731 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-4161ffb5-3f62-48e8-9786-0e756223d3e3 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:51.912038 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-4161ffb5-3f62-48e8-9786-0e756223d3e3 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:52.031776 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-17970e05-d204-408f-9801-2416ad527d3b tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:52.033401 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-17970e05-d204-408f-9801-2416ad527d3b tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] [instance: 16a06134-ea93-492f-a705-29cc31876c5d] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:52.039390 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-17970e05-d204-408f-9801-2416ad527d3b tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:52.039854 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-17970e05-d204-408f-9801-2416ad527d3b tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:52.040683 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-17970e05-d204-408f-9801-2416ad527d3b tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:52.041310 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-17970e05-d204-408f-9801-2416ad527d3b tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:52.045580 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_cell1:SELECT=100 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:44:52.046087 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-4161ffb5-3f62-48e8-9786-0e756223d3e3 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:52.053717 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-4161ffb5-3f62-48e8-9786-0e756223d3e3 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4" status: 200 len: 1368 microversion: 2.1 time: 0.160715 Jun 23 11:44:52.054973 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 66/126] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:51 2022] GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4 => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:44:52.172090 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-17970e05-d204-408f-9801-2416ad527d3b tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae72d6c494ba4f16989adfe090803d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515e65a705ee46cc8f8e03efbe58f177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:52.180506 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-17970e05-d204-408f-9801-2416ad527d3b tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] 10.222.0.13 "GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d" status: 200 len: 1314 microversion: 2.1 time: 0.152598 Jun 23 11:44:52.181082 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 61/127] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:52 2022] GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:44:52.765433 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [req-a1aa5e3b-887f-40be-b5fd-65fea0aeacae req-6e02d5f6-e21f-4446-b058-dab4e54e458f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "762e880e-7ec3-41bb-aac7-fa05de4efd11", "name": "network-vif-plugged", "status": "completed", "tag": "6fce142e-835a-4a3c-9803-6bb673a86c29"}]} {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:44:52.775035 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-a1aa5e3b-887f-40be-b5fd-65fea0aeacae req-6e02d5f6-e21f-4446-b058-dab4e54e458f service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:52.775519 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-a1aa5e3b-887f-40be-b5fd-65fea0aeacae req-6e02d5f6-e21f-4446-b058-dab4e54e458f service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:52.814576 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.compute.server_external_events [req-a1aa5e3b-887f-40be-b5fd-65fea0aeacae req-6e02d5f6-e21f-4446-b058-dab4e54e458f service nova] Creating event network-vif-plugged:6fce142e-835a-4a3c-9803-6bb673a86c29 for instance 762e880e-7ec3-41bb-aac7-fa05de4efd11 on hv-cinder-82099 Jun 23 11:44:52.814576 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [req-a1aa5e3b-887f-40be-b5fd-65fea0aeacae req-6e02d5f6-e21f-4446-b058-dab4e54e458f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103740 Jun 23 11:44:52.814576 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 67/128] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:44:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:44:52.908581 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-30399275-4d38-4ca4-8f5f-5574a2dd641c tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:52.909734 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-30399275-4d38-4ca4-8f5f-5574a2dd641c tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:52.916294 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-30399275-4d38-4ca4-8f5f-5574a2dd641c tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:52.916519 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-ecbedfcc-3030-4332-9aba-8e3e308a9464 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:52.916997 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-30399275-4d38-4ca4-8f5f-5574a2dd641c tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:52.917494 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-30399275-4d38-4ca4-8f5f-5574a2dd641c tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:52.917928 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-30399275-4d38-4ca4-8f5f-5574a2dd641c tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:52.918985 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-ecbedfcc-3030-4332-9aba-8e3e308a9464 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 0953fa06-0916-418f-b527-06d088cc6066] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:52.937967 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-ecbedfcc-3030-4332-9aba-8e3e308a9464 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:52.938985 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-ecbedfcc-3030-4332-9aba-8e3e308a9464 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:52.939772 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-ecbedfcc-3030-4332-9aba-8e3e308a9464 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:52.940207 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-ecbedfcc-3030-4332-9aba-8e3e308a9464 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:53.132915 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-30399275-4d38-4ca4-8f5f-5574a2dd641c tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:53.140667 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-30399275-4d38-4ca4-8f5f-5574a2dd641c tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 200 len: 1364 microversion: 2.1 time: 0.236466 Jun 23 11:44:53.141241 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 62/129] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:52 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 1364 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:44:53.145795 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-ecbedfcc-3030-4332-9aba-8e3e308a9464 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:53.153607 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-ecbedfcc-3030-4332-9aba-8e3e308a9464 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066" status: 200 len: 1322 microversion: 2.1 time: 0.243139 Jun 23 11:44:53.153859 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-1484cfc4-f28d-4c0e-9e14-0df5b8810881 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:53.154165 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 68/130] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:52 2022] GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066 => generated 1322 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:44:53.154477 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-1484cfc4-f28d-4c0e-9e14-0df5b8810881 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 250e2ce6-70ad-4082-8073-6a9cea0ca1e4] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:53.167338 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-1484cfc4-f28d-4c0e-9e14-0df5b8810881 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:53.167733 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-1484cfc4-f28d-4c0e-9e14-0df5b8810881 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:53.169814 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-1484cfc4-f28d-4c0e-9e14-0df5b8810881 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:53.170263 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-1484cfc4-f28d-4c0e-9e14-0df5b8810881 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:53.197259 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-4b36c80d-4178-4248-9ac9-e89dc4e67052 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:53.198220 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-4b36c80d-4178-4248-9ac9-e89dc4e67052 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] [instance: 16a06134-ea93-492f-a705-29cc31876c5d] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:53.206468 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-4b36c80d-4178-4248-9ac9-e89dc4e67052 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:53.207050 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-4b36c80d-4178-4248-9ac9-e89dc4e67052 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:53.212101 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-4b36c80d-4178-4248-9ac9-e89dc4e67052 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:53.212101 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-4b36c80d-4178-4248-9ac9-e89dc4e67052 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:53.382105 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-1484cfc4-f28d-4c0e-9e14-0df5b8810881 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:53.390316 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-1484cfc4-f28d-4c0e-9e14-0df5b8810881 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4" status: 200 len: 1368 microversion: 2.1 time: 0.247842 Jun 23 11:44:53.391785 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 63/131] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:53 2022] GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4 => generated 1368 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:44:53.398249 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-4b36c80d-4178-4248-9ac9-e89dc4e67052 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae72d6c494ba4f16989adfe090803d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515e65a705ee46cc8f8e03efbe58f177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:53.405980 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-4b36c80d-4178-4248-9ac9-e89dc4e67052 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] 10.222.0.13 "GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d" status: 200 len: 1314 microversion: 2.1 time: 0.212544 Jun 23 11:44:53.406547 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 69/132] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:53 2022] GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:44:54.158943 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-20d5de27-1480-4224-8c5a-a8afa450f5a0 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:54.159663 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-20d5de27-1480-4224-8c5a-a8afa450f5a0 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:54.165947 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-20d5de27-1480-4224-8c5a-a8afa450f5a0 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:54.166403 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-20d5de27-1480-4224-8c5a-a8afa450f5a0 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:54.168178 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-20d5de27-1480-4224-8c5a-a8afa450f5a0 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:54.168178 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-20d5de27-1480-4224-8c5a-a8afa450f5a0 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:54.170784 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-cb6f6d8f-b236-475e-b19a-f5fc54964e26 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:54.172903 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-cb6f6d8f-b236-475e-b19a-f5fc54964e26 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 0953fa06-0916-418f-b527-06d088cc6066] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:54.177946 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-cb6f6d8f-b236-475e-b19a-f5fc54964e26 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:54.178437 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-cb6f6d8f-b236-475e-b19a-f5fc54964e26 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:54.179217 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-cb6f6d8f-b236-475e-b19a-f5fc54964e26 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:54.179767 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-cb6f6d8f-b236-475e-b19a-f5fc54964e26 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:54.372831 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-20d5de27-1480-4224-8c5a-a8afa450f5a0 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:54.380576 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-cb6f6d8f-b236-475e-b19a-f5fc54964e26 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:54.386881 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-20d5de27-1480-4224-8c5a-a8afa450f5a0 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 200 len: 1364 microversion: 2.1 time: 0.231951 Jun 23 11:44:54.387468 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 64/133] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:54 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 1364 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:44:54.390438 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-cb6f6d8f-b236-475e-b19a-f5fc54964e26 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066" status: 200 len: 1322 microversion: 2.1 time: 0.223500 Jun 23 11:44:54.400928 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 70/134] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:54 2022] GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066 => generated 1322 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:44:54.407953 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-ebae6178-7c38-4a73-80c9-8e0afedca5ee tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:54.408666 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-ebae6178-7c38-4a73-80c9-8e0afedca5ee tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 250e2ce6-70ad-4082-8073-6a9cea0ca1e4] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:54.415327 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ebae6178-7c38-4a73-80c9-8e0afedca5ee tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:54.416165 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ebae6178-7c38-4a73-80c9-8e0afedca5ee tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:54.416597 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ebae6178-7c38-4a73-80c9-8e0afedca5ee tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:54.417030 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ebae6178-7c38-4a73-80c9-8e0afedca5ee tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:54.423377 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-8450b852-4e23-4f86-91d0-2f6ad120d6a6 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:54.424188 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-8450b852-4e23-4f86-91d0-2f6ad120d6a6 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] [instance: 16a06134-ea93-492f-a705-29cc31876c5d] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:54.432703 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-8450b852-4e23-4f86-91d0-2f6ad120d6a6 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:54.433320 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-8450b852-4e23-4f86-91d0-2f6ad120d6a6 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:54.434905 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-8450b852-4e23-4f86-91d0-2f6ad120d6a6 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:54.435488 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-8450b852-4e23-4f86-91d0-2f6ad120d6a6 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:54.622172 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-ebae6178-7c38-4a73-80c9-8e0afedca5ee tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:54.631136 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-8450b852-4e23-4f86-91d0-2f6ad120d6a6 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae72d6c494ba4f16989adfe090803d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515e65a705ee46cc8f8e03efbe58f177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:54.634249 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-ebae6178-7c38-4a73-80c9-8e0afedca5ee tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4" status: 200 len: 1368 microversion: 2.1 time: 0.230420 Jun 23 11:44:54.635262 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 65/135] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:54 2022] GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4 => generated 1368 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:44:54.643916 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-8450b852-4e23-4f86-91d0-2f6ad120d6a6 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] 10.222.0.13 "GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d" status: 200 len: 1314 microversion: 2.1 time: 0.224420 Jun 23 11:44:54.644786 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 71/136] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:54 2022] GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:44:55.407441 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-0ef9335e-2cbe-498d-807b-23dbc9574d30 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:55.408278 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-ab7ab862-9347-43ad-a392-6bfe322167bd tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:55.408694 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-0ef9335e-2cbe-498d-807b-23dbc9574d30 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:55.409826 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-ab7ab862-9347-43ad-a392-6bfe322167bd tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 0953fa06-0916-418f-b527-06d088cc6066] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:55.415337 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-0ef9335e-2cbe-498d-807b-23dbc9574d30 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:55.416578 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-0ef9335e-2cbe-498d-807b-23dbc9574d30 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:55.417724 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-0ef9335e-2cbe-498d-807b-23dbc9574d30 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:55.418169 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-0ef9335e-2cbe-498d-807b-23dbc9574d30 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:55.428589 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-ab7ab862-9347-43ad-a392-6bfe322167bd tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:55.432505 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-ab7ab862-9347-43ad-a392-6bfe322167bd tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:55.433489 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-ab7ab862-9347-43ad-a392-6bfe322167bd tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:55.435051 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-ab7ab862-9347-43ad-a392-6bfe322167bd tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:55.637859 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-0ef9335e-2cbe-498d-807b-23dbc9574d30 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:55.659977 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-ab7ab862-9347-43ad-a392-6bfe322167bd tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:55.660384 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-0ef9335e-2cbe-498d-807b-23dbc9574d30 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 200 len: 1364 microversion: 2.1 time: 0.244493 Jun 23 11:44:55.660384 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 66/137] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:55 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 1364 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:44:55.660530 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-ab7ab862-9347-43ad-a392-6bfe322167bd tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066" status: 200 len: 1322 microversion: 2.1 time: 0.246036 Jun 23 11:44:55.660530 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 72/138] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:55 2022] GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066 => generated 1322 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:44:55.660654 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-9b6dd1a1-a861-4737-a0ed-383f5b103268 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:55.660654 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-9b6dd1a1-a861-4737-a0ed-383f5b103268 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 250e2ce6-70ad-4082-8073-6a9cea0ca1e4] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:55.660654 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-9b6dd1a1-a861-4737-a0ed-383f5b103268 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:55.661099 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-9b6dd1a1-a861-4737-a0ed-383f5b103268 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:55.661751 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-9b6dd1a1-a861-4737-a0ed-383f5b103268 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:55.662444 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-8f5d6f6f-b8cc-4311-98a0-12eec97f10e1 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:55.662647 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-9b6dd1a1-a861-4737-a0ed-383f5b103268 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:55.662947 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-8f5d6f6f-b8cc-4311-98a0-12eec97f10e1 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] [instance: 16a06134-ea93-492f-a705-29cc31876c5d] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:55.669365 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-8f5d6f6f-b8cc-4311-98a0-12eec97f10e1 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:55.669854 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-8f5d6f6f-b8cc-4311-98a0-12eec97f10e1 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:55.671098 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-8f5d6f6f-b8cc-4311-98a0-12eec97f10e1 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:55.671616 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-8f5d6f6f-b8cc-4311-98a0-12eec97f10e1 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:55.861373 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-9b6dd1a1-a861-4737-a0ed-383f5b103268 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:55.870168 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-9b6dd1a1-a861-4737-a0ed-383f5b103268 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4" status: 200 len: 1368 microversion: 2.1 time: 0.220840 Jun 23 11:44:55.870988 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 67/139] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:55 2022] GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4 => generated 1368 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:44:55.872464 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-8f5d6f6f-b8cc-4311-98a0-12eec97f10e1 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae72d6c494ba4f16989adfe090803d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515e65a705ee46cc8f8e03efbe58f177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:55.881038 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-8f5d6f6f-b8cc-4311-98a0-12eec97f10e1 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] 10.222.0.13 "GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d" status: 200 len: 1314 microversion: 2.1 time: 0.224037 Jun 23 11:44:55.882133 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 73/140] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:55 2022] GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:44:56.667286 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-7d358c43-726c-4f65-b89b-8d58d1a327c4 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:56.668312 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-3bcd7f3a-6173-4d5a-9f10-67cd8f1e79f2 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:56.669237 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-7d358c43-726c-4f65-b89b-8d58d1a327c4 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 0953fa06-0916-418f-b527-06d088cc6066] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:56.669678 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-3bcd7f3a-6173-4d5a-9f10-67cd8f1e79f2 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:56.677278 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-3bcd7f3a-6173-4d5a-9f10-67cd8f1e79f2 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:56.677925 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-7d358c43-726c-4f65-b89b-8d58d1a327c4 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:56.678400 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-7d358c43-726c-4f65-b89b-8d58d1a327c4 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:56.679570 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-7d358c43-726c-4f65-b89b-8d58d1a327c4 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:56.680075 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-7d358c43-726c-4f65-b89b-8d58d1a327c4 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:56.681535 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-3bcd7f3a-6173-4d5a-9f10-67cd8f1e79f2 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:56.687652 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-3bcd7f3a-6173-4d5a-9f10-67cd8f1e79f2 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:56.687652 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-3bcd7f3a-6173-4d5a-9f10-67cd8f1e79f2 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:56.887326 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-3bcd7f3a-6173-4d5a-9f10-67cd8f1e79f2 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:56.892481 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-7d358c43-726c-4f65-b89b-8d58d1a327c4 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:56.896429 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-3bcd7f3a-6173-4d5a-9f10-67cd8f1e79f2 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 200 len: 1364 microversion: 2.1 time: 0.233145 Jun 23 11:44:56.898614 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 68/141] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:56 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 1364 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:44:56.901549 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-7d358c43-726c-4f65-b89b-8d58d1a327c4 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066" status: 200 len: 1322 microversion: 2.1 time: 0.238100 Jun 23 11:44:56.902295 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-0e4b3429-6a12-4b06-ae3a-68f395e3908b tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:56.914711 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 74/142] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:56 2022] GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066 => generated 1322 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:44:56.914835 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-0e4b3429-6a12-4b06-ae3a-68f395e3908b tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 250e2ce6-70ad-4082-8073-6a9cea0ca1e4] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:56.914918 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-b8d1177a-1393-46be-ae5e-bd8577775221 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:56.914918 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-b8d1177a-1393-46be-ae5e-bd8577775221 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] [instance: 16a06134-ea93-492f-a705-29cc31876c5d] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:56.915068 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-0e4b3429-6a12-4b06-ae3a-68f395e3908b tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:56.915068 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-0e4b3429-6a12-4b06-ae3a-68f395e3908b tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:56.915068 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-0e4b3429-6a12-4b06-ae3a-68f395e3908b tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:56.915068 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-0e4b3429-6a12-4b06-ae3a-68f395e3908b tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:56.915374 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-b8d1177a-1393-46be-ae5e-bd8577775221 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:56.915374 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-b8d1177a-1393-46be-ae5e-bd8577775221 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:56.915867 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-b8d1177a-1393-46be-ae5e-bd8577775221 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:56.916323 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-b8d1177a-1393-46be-ae5e-bd8577775221 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:57.303219 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-0e4b3429-6a12-4b06-ae3a-68f395e3908b tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:57.311471 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-0e4b3429-6a12-4b06-ae3a-68f395e3908b tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4" status: 200 len: 1368 microversion: 2.1 time: 0.413125 Jun 23 11:44:57.318304 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 69/143] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:56 2022] GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4 => generated 1368 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:44:57.320278 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-b8d1177a-1393-46be-ae5e-bd8577775221 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae72d6c494ba4f16989adfe090803d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515e65a705ee46cc8f8e03efbe58f177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:57.331157 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-b8d1177a-1393-46be-ae5e-bd8577775221 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] 10.222.0.13 "GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d" status: 200 len: 1314 microversion: 2.1 time: 0.427284 Jun 23 11:44:57.332116 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 75/144] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:56 2022] GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d => generated 1314 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:44:57.913519 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-098824d3-c597-41f6-9fd3-ab596b6c10ff tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:57.914047 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-098824d3-c597-41f6-9fd3-ab596b6c10ff tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:57.921027 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-098824d3-c597-41f6-9fd3-ab596b6c10ff tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:57.921507 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-098824d3-c597-41f6-9fd3-ab596b6c10ff tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:57.922277 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-2d1cd651-218b-4b57-9f7b-82ca61b9037b tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:57.922966 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-098824d3-c597-41f6-9fd3-ab596b6c10ff tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:57.923049 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-2d1cd651-218b-4b57-9f7b-82ca61b9037b tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 0953fa06-0916-418f-b527-06d088cc6066] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:57.923581 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-098824d3-c597-41f6-9fd3-ab596b6c10ff tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:57.929450 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-2d1cd651-218b-4b57-9f7b-82ca61b9037b tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:57.929973 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-2d1cd651-218b-4b57-9f7b-82ca61b9037b tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:57.930859 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-2d1cd651-218b-4b57-9f7b-82ca61b9037b tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:57.931361 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-2d1cd651-218b-4b57-9f7b-82ca61b9037b tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:58.116530 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-098824d3-c597-41f6-9fd3-ab596b6c10ff tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:58.136368 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-098824d3-c597-41f6-9fd3-ab596b6c10ff tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 200 len: 1364 microversion: 2.1 time: 0.214634 Jun 23 11:44:58.136368 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 70/145] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:57 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 1364 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:44:58.195135 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-2d1cd651-218b-4b57-9f7b-82ca61b9037b tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:58.202629 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-2d1cd651-218b-4b57-9f7b-82ca61b9037b tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066" status: 200 len: 1322 microversion: 2.1 time: 0.284465 Jun 23 11:44:58.203185 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 76/146] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:57 2022] GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066 => generated 1322 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:44:58.329513 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-8508decd-f7bc-4f8a-9aed-186ac23cee6f tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:58.330136 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-8508decd-f7bc-4f8a-9aed-186ac23cee6f tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 250e2ce6-70ad-4082-8073-6a9cea0ca1e4] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:58.336747 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-8508decd-f7bc-4f8a-9aed-186ac23cee6f tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:58.337194 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-8508decd-f7bc-4f8a-9aed-186ac23cee6f tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:58.337957 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-8508decd-f7bc-4f8a-9aed-186ac23cee6f tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:58.338391 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-8508decd-f7bc-4f8a-9aed-186ac23cee6f tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:58.349698 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-ea0e5712-9a0c-452e-984e-c5902d824601 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:58.350410 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-ea0e5712-9a0c-452e-984e-c5902d824601 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] [instance: 16a06134-ea93-492f-a705-29cc31876c5d] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:58.357549 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-ea0e5712-9a0c-452e-984e-c5902d824601 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:58.358074 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-ea0e5712-9a0c-452e-984e-c5902d824601 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:58.359568 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-ea0e5712-9a0c-452e-984e-c5902d824601 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:58.360926 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-ea0e5712-9a0c-452e-984e-c5902d824601 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:58.577233 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-8508decd-f7bc-4f8a-9aed-186ac23cee6f tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:58.580246 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-ea0e5712-9a0c-452e-984e-c5902d824601 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae72d6c494ba4f16989adfe090803d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515e65a705ee46cc8f8e03efbe58f177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:58.588269 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-ea0e5712-9a0c-452e-984e-c5902d824601 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] 10.222.0.13 "GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d" status: 200 len: 1314 microversion: 2.1 time: 0.242798 Jun 23 11:44:58.589021 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-8508decd-f7bc-4f8a-9aed-186ac23cee6f tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4" status: 200 len: 1368 microversion: 2.1 time: 0.263395 Jun 23 11:44:58.598369 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 77/147] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:58 2022] GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:44:58.599586 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 71/148] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:58 2022] GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4 => generated 1368 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:44:59.145599 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-b1843658-4200-4b28-a0a2-00852c1e7b38 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:59.146918 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-b1843658-4200-4b28-a0a2-00852c1e7b38 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:59.153438 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-b1843658-4200-4b28-a0a2-00852c1e7b38 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:59.153922 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-b1843658-4200-4b28-a0a2-00852c1e7b38 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:59.154684 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-b1843658-4200-4b28-a0a2-00852c1e7b38 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:59.155170 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-b1843658-4200-4b28-a0a2-00852c1e7b38 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:59.220562 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-e33139fb-40f4-462d-a037-b8c53f78a173 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:59.221186 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-e33139fb-40f4-462d-a037-b8c53f78a173 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 0953fa06-0916-418f-b527-06d088cc6066] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:59.228302 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-e33139fb-40f4-462d-a037-b8c53f78a173 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:59.228755 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-e33139fb-40f4-462d-a037-b8c53f78a173 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:59.235154 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-e33139fb-40f4-462d-a037-b8c53f78a173 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:59.235853 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-e33139fb-40f4-462d-a037-b8c53f78a173 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:59.330184 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-b1843658-4200-4b28-a0a2-00852c1e7b38 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:59.337949 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-b1843658-4200-4b28-a0a2-00852c1e7b38 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 200 len: 1364 microversion: 2.1 time: 0.197960 Jun 23 11:44:59.338610 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 78/149] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:59 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 1364 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:44:59.416842 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-e33139fb-40f4-462d-a037-b8c53f78a173 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:59.426044 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-e33139fb-40f4-462d-a037-b8c53f78a173 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066" status: 200 len: 1322 microversion: 2.1 time: 0.209977 Jun 23 11:44:59.431567 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 72/150] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:59 2022] GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066 => generated 1322 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:44:59.607782 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-039686a8-b981-4be5-9b6c-839a30c2dd18 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:59.608645 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-039686a8-b981-4be5-9b6c-839a30c2dd18 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] [instance: 16a06134-ea93-492f-a705-29cc31876c5d] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:59.609533 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-b8dde423-030b-4dd3-b6c8-18c40feefe53 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:44:59.610457 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-b8dde423-030b-4dd3-b6c8-18c40feefe53 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 250e2ce6-70ad-4082-8073-6a9cea0ca1e4] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:44:59.616577 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-039686a8-b981-4be5-9b6c-839a30c2dd18 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:59.617011 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-039686a8-b981-4be5-9b6c-839a30c2dd18 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:59.617773 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-039686a8-b981-4be5-9b6c-839a30c2dd18 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:59.618218 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-039686a8-b981-4be5-9b6c-839a30c2dd18 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:59.620862 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-b8dde423-030b-4dd3-b6c8-18c40feefe53 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:59.622384 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-b8dde423-030b-4dd3-b6c8-18c40feefe53 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:59.624557 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-b8dde423-030b-4dd3-b6c8-18c40feefe53 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:44:59.626726 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-b8dde423-030b-4dd3-b6c8-18c40feefe53 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:44:59.850071 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-039686a8-b981-4be5-9b6c-839a30c2dd18 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae72d6c494ba4f16989adfe090803d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515e65a705ee46cc8f8e03efbe58f177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:59.864016 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-039686a8-b981-4be5-9b6c-839a30c2dd18 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] 10.222.0.13 "GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d" status: 200 len: 1314 microversion: 2.1 time: 0.260886 Jun 23 11:44:59.875310 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 79/151] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:59 2022] GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d => generated 1314 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:44:59.877651 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-b8dde423-030b-4dd3-b6c8-18c40feefe53 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:44:59.885522 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-b8dde423-030b-4dd3-b6c8-18c40feefe53 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4" status: 200 len: 1368 microversion: 2.1 time: 0.282411 Jun 23 11:44:59.886153 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 73/152] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:44:59 2022] GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4 => generated 1368 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:45:00.159673 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [req-fd1343a4-b97d-4214-88be-2fa0be40037c req-bad0ed34-c260-40d6-aa3f-16b3e21b2d95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0953fa06-0916-418f-b527-06d088cc6066", "name": "network-vif-plugged", "status": "completed", "tag": "56dc5915-6e20-441e-8915-6463dfb576ba"}]} {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:45:00.171127 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-fd1343a4-b97d-4214-88be-2fa0be40037c req-bad0ed34-c260-40d6-aa3f-16b3e21b2d95 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:00.171758 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-fd1343a4-b97d-4214-88be-2fa0be40037c req-bad0ed34-c260-40d6-aa3f-16b3e21b2d95 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:00.184168 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.compute.server_external_events [req-fd1343a4-b97d-4214-88be-2fa0be40037c req-bad0ed34-c260-40d6-aa3f-16b3e21b2d95 service nova] Creating event network-vif-plugged:56dc5915-6e20-441e-8915-6463dfb576ba for instance 0953fa06-0916-418f-b527-06d088cc6066 on hv-cinder-82099 Jun 23 11:45:00.200124 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [req-fd1343a4-b97d-4214-88be-2fa0be40037c req-bad0ed34-c260-40d6-aa3f-16b3e21b2d95 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046195 Jun 23 11:45:00.200792 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 80/153] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:45:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:45:00.356348 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-daa2b422-36ef-4569-919d-ef590a822ada tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:00.357030 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-daa2b422-36ef-4569-919d-ef590a822ada tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:00.364229 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-daa2b422-36ef-4569-919d-ef590a822ada tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:00.364678 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-daa2b422-36ef-4569-919d-ef590a822ada tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:00.365610 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-daa2b422-36ef-4569-919d-ef590a822ada tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:00.366193 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-daa2b422-36ef-4569-919d-ef590a822ada tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:00.443549 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-f6de983a-bfc9-46e9-8304-73633fb55390 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:00.444273 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-f6de983a-bfc9-46e9-8304-73633fb55390 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 0953fa06-0916-418f-b527-06d088cc6066] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:00.450771 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-f6de983a-bfc9-46e9-8304-73633fb55390 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:00.451279 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-f6de983a-bfc9-46e9-8304-73633fb55390 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:00.451954 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-f6de983a-bfc9-46e9-8304-73633fb55390 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:00.452384 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-f6de983a-bfc9-46e9-8304-73633fb55390 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:00.542802 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-daa2b422-36ef-4569-919d-ef590a822ada tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:00.555470 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-daa2b422-36ef-4569-919d-ef590a822ada tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 200 len: 1364 microversion: 2.1 time: 0.203117 Jun 23 11:45:00.556062 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 74/154] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:00 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 1364 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:45:00.631182 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-f6de983a-bfc9-46e9-8304-73633fb55390 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:00.639366 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-f6de983a-bfc9-46e9-8304-73633fb55390 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066" status: 200 len: 1322 microversion: 2.1 time: 0.199886 Jun 23 11:45:00.640445 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 81/155] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:00 2022] GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066 => generated 1322 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:45:00.882294 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-27016952-abd9-4dca-8bab-896abb388084 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:00.882941 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-27016952-abd9-4dca-8bab-896abb388084 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] [instance: 16a06134-ea93-492f-a705-29cc31876c5d] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:00.888773 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-27016952-abd9-4dca-8bab-896abb388084 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:00.889222 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-27016952-abd9-4dca-8bab-896abb388084 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:00.889979 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-27016952-abd9-4dca-8bab-896abb388084 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:00.890408 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-27016952-abd9-4dca-8bab-896abb388084 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:00.903340 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-b6ac69cb-b7c1-44e3-ba10-f4e1572905e1 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:00.904070 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-b6ac69cb-b7c1-44e3-ba10-f4e1572905e1 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 250e2ce6-70ad-4082-8073-6a9cea0ca1e4] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:00.910191 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-b6ac69cb-b7c1-44e3-ba10-f4e1572905e1 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:00.910667 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-b6ac69cb-b7c1-44e3-ba10-f4e1572905e1 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:00.911557 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-b6ac69cb-b7c1-44e3-ba10-f4e1572905e1 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:00.911964 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-b6ac69cb-b7c1-44e3-ba10-f4e1572905e1 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:00.943228 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_cell1:SELECT=100 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:45:01.101992 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-27016952-abd9-4dca-8bab-896abb388084 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae72d6c494ba4f16989adfe090803d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515e65a705ee46cc8f8e03efbe58f177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:01.113014 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-27016952-abd9-4dca-8bab-896abb388084 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] 10.222.0.13 "GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d" status: 200 len: 1314 microversion: 2.1 time: 0.234026 Jun 23 11:45:01.114008 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 75/156] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:00 2022] GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:45:01.143598 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-b6ac69cb-b7c1-44e3-ba10-f4e1572905e1 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:01.150903 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-b6ac69cb-b7c1-44e3-ba10-f4e1572905e1 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4" status: 200 len: 1368 microversion: 2.1 time: 0.251623 Jun 23 11:45:01.151459 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 82/157] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:00 2022] GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4 => generated 1368 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:45:01.585155 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-dcc4940a-f3f2-4c9d-8a64-e0f88128135d tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:01.585755 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-dcc4940a-f3f2-4c9d-8a64-e0f88128135d tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:01.596441 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-dcc4940a-f3f2-4c9d-8a64-e0f88128135d tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:01.597016 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-dcc4940a-f3f2-4c9d-8a64-e0f88128135d tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:01.597852 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-dcc4940a-f3f2-4c9d-8a64-e0f88128135d tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:01.598352 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-dcc4940a-f3f2-4c9d-8a64-e0f88128135d tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:01.657263 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-ba4fd462-ab6c-4887-8c4c-c7669d966329 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:01.658753 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-ba4fd462-ab6c-4887-8c4c-c7669d966329 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 0953fa06-0916-418f-b527-06d088cc6066] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:01.665702 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-ba4fd462-ab6c-4887-8c4c-c7669d966329 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:01.666456 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-ba4fd462-ab6c-4887-8c4c-c7669d966329 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:01.667479 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-ba4fd462-ab6c-4887-8c4c-c7669d966329 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:01.674116 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-ba4fd462-ab6c-4887-8c4c-c7669d966329 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:01.817023 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-dcc4940a-f3f2-4c9d-8a64-e0f88128135d tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:01.824832 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-dcc4940a-f3f2-4c9d-8a64-e0f88128135d tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 200 len: 1364 microversion: 2.1 time: 0.243716 Jun 23 11:45:01.825433 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 76/158] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:01 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 1364 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:45:01.893970 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-ba4fd462-ab6c-4887-8c4c-c7669d966329 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:01.901641 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-ba4fd462-ab6c-4887-8c4c-c7669d966329 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066" status: 200 len: 1322 microversion: 2.1 time: 0.248329 Jun 23 11:45:01.902214 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 83/159] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:01 2022] GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066 => generated 1322 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:45:02.131553 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-09a31cb2-0f68-4a1d-9552-855da248c8a1 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:02.135734 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-09a31cb2-0f68-4a1d-9552-855da248c8a1 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] [instance: 16a06134-ea93-492f-a705-29cc31876c5d] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:02.138887 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-09a31cb2-0f68-4a1d-9552-855da248c8a1 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:02.139322 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-09a31cb2-0f68-4a1d-9552-855da248c8a1 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:02.140088 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-09a31cb2-0f68-4a1d-9552-855da248c8a1 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:02.140879 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-09a31cb2-0f68-4a1d-9552-855da248c8a1 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:02.170684 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-3e9a9c00-3321-4b6d-adae-2bbca90deeaf tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:02.171495 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-3e9a9c00-3321-4b6d-adae-2bbca90deeaf tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 250e2ce6-70ad-4082-8073-6a9cea0ca1e4] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:02.181081 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-3e9a9c00-3321-4b6d-adae-2bbca90deeaf tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:02.181849 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-3e9a9c00-3321-4b6d-adae-2bbca90deeaf tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:02.184955 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-3e9a9c00-3321-4b6d-adae-2bbca90deeaf tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:02.185590 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-3e9a9c00-3321-4b6d-adae-2bbca90deeaf tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:02.396143 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-09a31cb2-0f68-4a1d-9552-855da248c8a1 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae72d6c494ba4f16989adfe090803d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515e65a705ee46cc8f8e03efbe58f177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:02.411599 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_cell1:SELECT=100 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:45:02.414250 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-09a31cb2-0f68-4a1d-9552-855da248c8a1 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] 10.222.0.13 "GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d" status: 200 len: 1314 microversion: 2.1 time: 0.287412 Jun 23 11:45:02.417355 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-3e9a9c00-3321-4b6d-adae-2bbca90deeaf tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:02.425814 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-3e9a9c00-3321-4b6d-adae-2bbca90deeaf tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4" status: 200 len: 1368 microversion: 2.1 time: 0.260240 Jun 23 11:45:02.432635 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 84/160] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:02 2022] GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4 => generated 1368 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:45:02.432760 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 77/161] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:02 2022] GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d => generated 1314 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:45:02.432853 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [req-e51f6f38-7869-4650-a90d-82f4dc1a3182 req-07d2c017-4c17-44bf-9005-2d57eed11801 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16a06134-ea93-492f-a705-29cc31876c5d", "name": "network-vif-plugged", "status": "completed", "tag": "66ff8d4e-945d-42bc-b261-4309e6e07015"}]} {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:45:02.443006 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-e51f6f38-7869-4650-a90d-82f4dc1a3182 req-07d2c017-4c17-44bf-9005-2d57eed11801 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:02.443443 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-e51f6f38-7869-4650-a90d-82f4dc1a3182 req-07d2c017-4c17-44bf-9005-2d57eed11801 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:02.454298 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.compute.server_external_events [req-e51f6f38-7869-4650-a90d-82f4dc1a3182 req-07d2c017-4c17-44bf-9005-2d57eed11801 service nova] Creating event network-vif-plugged:66ff8d4e-945d-42bc-b261-4309e6e07015 for instance 16a06134-ea93-492f-a705-29cc31876c5d on hv-cinder-82099 Jun 23 11:45:02.465978 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [req-e51f6f38-7869-4650-a90d-82f4dc1a3182 req-07d2c017-4c17-44bf-9005-2d57eed11801 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038227 Jun 23 11:45:02.466605 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 85/162] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:45:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:45:02.842933 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-1c3534b8-ed6b-4194-9053-6e15fed70853 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:02.843529 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-1c3534b8-ed6b-4194-9053-6e15fed70853 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:02.853636 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-1c3534b8-ed6b-4194-9053-6e15fed70853 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:02.854356 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-1c3534b8-ed6b-4194-9053-6e15fed70853 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:02.855662 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-1c3534b8-ed6b-4194-9053-6e15fed70853 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:02.856374 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-1c3534b8-ed6b-4194-9053-6e15fed70853 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:02.919484 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-e775f2a7-2c73-4845-8b07-c04d0ecbb6fa tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:02.922272 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-e775f2a7-2c73-4845-8b07-c04d0ecbb6fa tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 0953fa06-0916-418f-b527-06d088cc6066] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:02.922272 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_api:SELECT=100 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:45:02.933269 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-e775f2a7-2c73-4845-8b07-c04d0ecbb6fa tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:02.933655 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-e775f2a7-2c73-4845-8b07-c04d0ecbb6fa tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:02.936165 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-e775f2a7-2c73-4845-8b07-c04d0ecbb6fa tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:02.936773 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-e775f2a7-2c73-4845-8b07-c04d0ecbb6fa tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:03.059256 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-1c3534b8-ed6b-4194-9053-6e15fed70853 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:03.066814 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-1c3534b8-ed6b-4194-9053-6e15fed70853 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 200 len: 1364 microversion: 2.1 time: 0.228056 Jun 23 11:45:03.067382 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 78/163] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:02 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 1364 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:45:03.106288 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-e775f2a7-2c73-4845-8b07-c04d0ecbb6fa tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:03.113838 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-e775f2a7-2c73-4845-8b07-c04d0ecbb6fa tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066" status: 200 len: 1322 microversion: 2.1 time: 0.198514 Jun 23 11:45:03.114377 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 86/164] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:02 2022] GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066 => generated 1322 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:45:03.449039 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-abe76b5b-077b-4d8d-9858-b06b1640c11c tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:03.452303 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-9ebaa142-b5cd-4b95-b4bd-d82ce02594d7 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:03.452912 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-9ebaa142-b5cd-4b95-b4bd-d82ce02594d7 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 250e2ce6-70ad-4082-8073-6a9cea0ca1e4] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:03.457018 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-abe76b5b-077b-4d8d-9858-b06b1640c11c tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] [instance: 16a06134-ea93-492f-a705-29cc31876c5d] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:03.468032 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-abe76b5b-077b-4d8d-9858-b06b1640c11c tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:03.468479 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-abe76b5b-077b-4d8d-9858-b06b1640c11c tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:03.471168 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-abe76b5b-077b-4d8d-9858-b06b1640c11c tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:03.472359 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-9ebaa142-b5cd-4b95-b4bd-d82ce02594d7 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:03.472990 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-abe76b5b-077b-4d8d-9858-b06b1640c11c tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:03.477190 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-9ebaa142-b5cd-4b95-b4bd-d82ce02594d7 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:03.478009 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-9ebaa142-b5cd-4b95-b4bd-d82ce02594d7 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:03.478431 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-9ebaa142-b5cd-4b95-b4bd-d82ce02594d7 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:03.698784 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-abe76b5b-077b-4d8d-9858-b06b1640c11c tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae72d6c494ba4f16989adfe090803d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515e65a705ee46cc8f8e03efbe58f177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:03.703072 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-9ebaa142-b5cd-4b95-b4bd-d82ce02594d7 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:03.707143 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-abe76b5b-077b-4d8d-9858-b06b1640c11c tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] 10.222.0.13 "GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d" status: 200 len: 1314 microversion: 2.1 time: 0.264202 Jun 23 11:45:03.710709 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 87/165] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:03 2022] GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d => generated 1314 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:45:03.712280 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-9ebaa142-b5cd-4b95-b4bd-d82ce02594d7 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4" status: 200 len: 1368 microversion: 2.1 time: 0.273054 Jun 23 11:45:03.712869 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 79/166] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:03 2022] GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4 => generated 1368 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:45:04.086115 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-724f8296-5b28-40fe-bda9-5a00d933d78c tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:04.086666 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-724f8296-5b28-40fe-bda9-5a00d933d78c tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:04.096555 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-724f8296-5b28-40fe-bda9-5a00d933d78c tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:04.097466 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-724f8296-5b28-40fe-bda9-5a00d933d78c tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:04.098608 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-724f8296-5b28-40fe-bda9-5a00d933d78c tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:04.099293 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-724f8296-5b28-40fe-bda9-5a00d933d78c tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:04.132356 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-92ba78d1-ea7b-4696-9a80-aa7ae4100805 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:04.134268 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-92ba78d1-ea7b-4696-9a80-aa7ae4100805 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 0953fa06-0916-418f-b527-06d088cc6066] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:04.142000 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-92ba78d1-ea7b-4696-9a80-aa7ae4100805 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:04.143383 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-92ba78d1-ea7b-4696-9a80-aa7ae4100805 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:04.144465 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-92ba78d1-ea7b-4696-9a80-aa7ae4100805 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:04.145065 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-92ba78d1-ea7b-4696-9a80-aa7ae4100805 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:04.322867 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-724f8296-5b28-40fe-bda9-5a00d933d78c tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:04.332526 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-724f8296-5b28-40fe-bda9-5a00d933d78c tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 200 len: 1364 microversion: 2.1 time: 0.251532 Jun 23 11:45:04.345511 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 88/167] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:04 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 1364 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:45:04.351958 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-92ba78d1-ea7b-4696-9a80-aa7ae4100805 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:04.362426 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-92ba78d1-ea7b-4696-9a80-aa7ae4100805 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066" status: 200 len: 1322 microversion: 2.1 time: 0.233908 Jun 23 11:45:04.362426 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 80/168] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:04 2022] GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066 => generated 1322 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:45:04.725266 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-e89c8a52-1205-42e2-986d-8f888f6d4029 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:04.725877 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-e89c8a52-1205-42e2-986d-8f888f6d4029 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] [instance: 16a06134-ea93-492f-a705-29cc31876c5d] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:04.732398 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-e89c8a52-1205-42e2-986d-8f888f6d4029 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:04.733022 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-e89c8a52-1205-42e2-986d-8f888f6d4029 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:04.733689 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-7862e6b7-03d9-4412-9592-584a68c97293 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:04.733804 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-e89c8a52-1205-42e2-986d-8f888f6d4029 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:04.734253 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-e89c8a52-1205-42e2-986d-8f888f6d4029 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:04.734916 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-7862e6b7-03d9-4412-9592-584a68c97293 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 250e2ce6-70ad-4082-8073-6a9cea0ca1e4] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:04.742340 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-7862e6b7-03d9-4412-9592-584a68c97293 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:04.742880 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-7862e6b7-03d9-4412-9592-584a68c97293 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:04.743896 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-7862e6b7-03d9-4412-9592-584a68c97293 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:04.744450 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-7862e6b7-03d9-4412-9592-584a68c97293 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:04.947270 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-e89c8a52-1205-42e2-986d-8f888f6d4029 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae72d6c494ba4f16989adfe090803d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515e65a705ee46cc8f8e03efbe58f177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:04.956254 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-e89c8a52-1205-42e2-986d-8f888f6d4029 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] 10.222.0.13 "GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d" status: 200 len: 1314 microversion: 2.1 time: 0.235273 Jun 23 11:45:04.956833 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 89/169] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:04 2022] GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:45:04.972193 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-7862e6b7-03d9-4412-9592-584a68c97293 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:04.979829 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-7862e6b7-03d9-4412-9592-584a68c97293 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4" status: 200 len: 1368 microversion: 2.1 time: 0.252945 Jun 23 11:45:04.980401 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 81/170] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:04 2022] GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4 => generated 1368 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:45:05.351642 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-afeba4f0-16e6-4296-b841-601288ddeaec tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:05.352340 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-afeba4f0-16e6-4296-b841-601288ddeaec tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:05.358510 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-afeba4f0-16e6-4296-b841-601288ddeaec tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:05.358987 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-afeba4f0-16e6-4296-b841-601288ddeaec tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:05.359812 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-afeba4f0-16e6-4296-b841-601288ddeaec tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:05.360954 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-afeba4f0-16e6-4296-b841-601288ddeaec tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:05.387041 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-4c189ae7-227e-4ab1-8ec6-5c06946e6400 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:05.387677 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-4c189ae7-227e-4ab1-8ec6-5c06946e6400 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 0953fa06-0916-418f-b527-06d088cc6066] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:05.394230 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-4c189ae7-227e-4ab1-8ec6-5c06946e6400 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:05.398204 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-4c189ae7-227e-4ab1-8ec6-5c06946e6400 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:05.398651 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-4c189ae7-227e-4ab1-8ec6-5c06946e6400 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:05.398896 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-4c189ae7-227e-4ab1-8ec6-5c06946e6400 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:05.617557 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-afeba4f0-16e6-4296-b841-601288ddeaec tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:05.620207 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-4c189ae7-227e-4ab1-8ec6-5c06946e6400 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:05.627862 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-afeba4f0-16e6-4296-b841-601288ddeaec tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 200 len: 1364 microversion: 2.1 time: 0.278750 Jun 23 11:45:05.637331 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-4c189ae7-227e-4ab1-8ec6-5c06946e6400 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066" status: 200 len: 1322 microversion: 2.1 time: 0.246164 Jun 23 11:45:05.637465 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 90/171] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:05 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 1364 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:45:05.637571 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 82/172] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:05 2022] GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066 => generated 1322 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:45:05.974601 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-916d2052-cb08-43aa-b609-94ef124e505f tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:05.975584 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-916d2052-cb08-43aa-b609-94ef124e505f tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] [instance: 16a06134-ea93-492f-a705-29cc31876c5d] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:05.981658 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-916d2052-cb08-43aa-b609-94ef124e505f tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:05.982097 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-916d2052-cb08-43aa-b609-94ef124e505f tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:05.982880 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-916d2052-cb08-43aa-b609-94ef124e505f tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:05.983303 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-916d2052-cb08-43aa-b609-94ef124e505f tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:06.004689 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-708a7660-87f9-43b4-8860-5634c813c77f tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:06.008663 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-708a7660-87f9-43b4-8860-5634c813c77f tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 250e2ce6-70ad-4082-8073-6a9cea0ca1e4] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:06.011507 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-708a7660-87f9-43b4-8860-5634c813c77f tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:06.012154 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-708a7660-87f9-43b4-8860-5634c813c77f tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:06.013100 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-708a7660-87f9-43b4-8860-5634c813c77f tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:06.013865 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-708a7660-87f9-43b4-8860-5634c813c77f tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:06.201631 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-916d2052-cb08-43aa-b609-94ef124e505f tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae72d6c494ba4f16989adfe090803d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515e65a705ee46cc8f8e03efbe58f177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:06.208842 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-708a7660-87f9-43b4-8860-5634c813c77f tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:06.210817 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-916d2052-cb08-43aa-b609-94ef124e505f tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] 10.222.0.13 "GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d" status: 200 len: 1314 microversion: 2.1 time: 0.241613 Jun 23 11:45:06.211696 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 91/173] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:05 2022] GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:45:06.216686 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-708a7660-87f9-43b4-8860-5634c813c77f tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4" status: 200 len: 1368 microversion: 2.1 time: 0.216374 Jun 23 11:45:06.217232 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 83/174] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:05 2022] GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4 => generated 1368 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:45:06.645082 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-57dc4704-2f36-47cb-b8ad-2db96a4f5fb1 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:06.645598 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-0ba77719-1f5f-45f1-985f-f762492eee54 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:06.645943 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-57dc4704-2f36-47cb-b8ad-2db96a4f5fb1 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:06.646225 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-0ba77719-1f5f-45f1-985f-f762492eee54 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 0953fa06-0916-418f-b527-06d088cc6066] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:06.651739 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-57dc4704-2f36-47cb-b8ad-2db96a4f5fb1 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:06.652181 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-57dc4704-2f36-47cb-b8ad-2db96a4f5fb1 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:06.652516 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-0ba77719-1f5f-45f1-985f-f762492eee54 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:06.653273 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-0ba77719-1f5f-45f1-985f-f762492eee54 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:06.653596 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-57dc4704-2f36-47cb-b8ad-2db96a4f5fb1 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:06.654026 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-0ba77719-1f5f-45f1-985f-f762492eee54 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:06.654522 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-0ba77719-1f5f-45f1-985f-f762492eee54 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:06.654761 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-57dc4704-2f36-47cb-b8ad-2db96a4f5fb1 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:06.860830 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-57dc4704-2f36-47cb-b8ad-2db96a4f5fb1 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:06.865111 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-0ba77719-1f5f-45f1-985f-f762492eee54 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:06.868406 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-57dc4704-2f36-47cb-b8ad-2db96a4f5fb1 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 200 len: 1364 microversion: 2.1 time: 0.227446 Jun 23 11:45:06.868977 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 92/175] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:06 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 1364 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:45:06.872944 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-0ba77719-1f5f-45f1-985f-f762492eee54 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066" status: 200 len: 1322 microversion: 2.1 time: 0.231553 Jun 23 11:45:06.873502 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 84/176] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:06 2022] GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066 => generated 1322 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:45:07.228468 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-252a1cdc-b3c8-4068-821c-029b00dd23fc tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:07.229068 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-252a1cdc-b3c8-4068-821c-029b00dd23fc tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] [instance: 16a06134-ea93-492f-a705-29cc31876c5d] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:07.232702 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-86e2ec63-5fcd-456a-9d28-919293a0f81a tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:07.233385 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-86e2ec63-5fcd-456a-9d28-919293a0f81a tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 250e2ce6-70ad-4082-8073-6a9cea0ca1e4] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:07.235286 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-252a1cdc-b3c8-4068-821c-029b00dd23fc tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:07.235743 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-252a1cdc-b3c8-4068-821c-029b00dd23fc tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:07.236513 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-252a1cdc-b3c8-4068-821c-029b00dd23fc tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:07.237061 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-252a1cdc-b3c8-4068-821c-029b00dd23fc tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:07.239291 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-86e2ec63-5fcd-456a-9d28-919293a0f81a tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:07.239726 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-86e2ec63-5fcd-456a-9d28-919293a0f81a tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:07.240470 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-86e2ec63-5fcd-456a-9d28-919293a0f81a tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:07.240893 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-86e2ec63-5fcd-456a-9d28-919293a0f81a tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:07.484661 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-252a1cdc-b3c8-4068-821c-029b00dd23fc tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae72d6c494ba4f16989adfe090803d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515e65a705ee46cc8f8e03efbe58f177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:07.501094 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-252a1cdc-b3c8-4068-821c-029b00dd23fc tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] 10.222.0.13 "GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d" status: 200 len: 1314 microversion: 2.1 time: 0.276358 Jun 23 11:45:07.502046 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 93/177] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:07 2022] GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:45:07.538915 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-86e2ec63-5fcd-456a-9d28-919293a0f81a tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:07.553719 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-86e2ec63-5fcd-456a-9d28-919293a0f81a tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4" status: 200 len: 1368 microversion: 2.1 time: 0.324775 Jun 23 11:45:07.554556 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 85/178] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:07 2022] GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4 => generated 1368 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:45:07.890124 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-d4015348-80ca-4d24-90a5-60c08c7aa5dd tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:07.891343 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-a8963a7a-d41f-44b8-baac-f0ead5953136 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:07.892070 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-a8963a7a-d41f-44b8-baac-f0ead5953136 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:07.893046 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-d4015348-80ca-4d24-90a5-60c08c7aa5dd tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 0953fa06-0916-418f-b527-06d088cc6066] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:07.901066 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-d4015348-80ca-4d24-90a5-60c08c7aa5dd tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:07.901839 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-d4015348-80ca-4d24-90a5-60c08c7aa5dd tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:07.902065 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a8963a7a-d41f-44b8-baac-f0ead5953136 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:07.902703 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a8963a7a-d41f-44b8-baac-f0ead5953136 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:07.903633 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-d4015348-80ca-4d24-90a5-60c08c7aa5dd tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:07.904247 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-d4015348-80ca-4d24-90a5-60c08c7aa5dd tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:07.904596 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a8963a7a-d41f-44b8-baac-f0ead5953136 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:07.905138 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a8963a7a-d41f-44b8-baac-f0ead5953136 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:08.174140 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-a8963a7a-d41f-44b8-baac-f0ead5953136 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:08.177831 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-d4015348-80ca-4d24-90a5-60c08c7aa5dd tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:08.184140 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-a8963a7a-d41f-44b8-baac-f0ead5953136 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 200 len: 1364 microversion: 2.1 time: 0.301009 Jun 23 11:45:08.184710 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 94/179] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:07 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 1364 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:45:08.185735 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-d4015348-80ca-4d24-90a5-60c08c7aa5dd tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066" status: 200 len: 1322 microversion: 2.1 time: 0.300207 Jun 23 11:45:08.186567 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 86/180] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:07 2022] GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066 => generated 1322 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:45:08.517473 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-e88c187d-cf33-4082-8cc7-a3b759ecf404 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:08.518471 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-e88c187d-cf33-4082-8cc7-a3b759ecf404 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] [instance: 16a06134-ea93-492f-a705-29cc31876c5d] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:08.527541 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-e88c187d-cf33-4082-8cc7-a3b759ecf404 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:08.528361 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-e88c187d-cf33-4082-8cc7-a3b759ecf404 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:08.529327 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-e88c187d-cf33-4082-8cc7-a3b759ecf404 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:08.530243 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-e88c187d-cf33-4082-8cc7-a3b759ecf404 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:08.576628 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-c2be0186-f93c-444d-9ef2-5778553421ca tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:08.577420 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-c2be0186-f93c-444d-9ef2-5778553421ca tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 250e2ce6-70ad-4082-8073-6a9cea0ca1e4] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:08.588418 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c2be0186-f93c-444d-9ef2-5778553421ca tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:08.590255 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c2be0186-f93c-444d-9ef2-5778553421ca tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:08.591815 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c2be0186-f93c-444d-9ef2-5778553421ca tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:08.594108 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c2be0186-f93c-444d-9ef2-5778553421ca tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:09.039645 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-e88c187d-cf33-4082-8cc7-a3b759ecf404 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae72d6c494ba4f16989adfe090803d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515e65a705ee46cc8f8e03efbe58f177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:09.046674 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-c2be0186-f93c-444d-9ef2-5778553421ca tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:09.048199 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-e88c187d-cf33-4082-8cc7-a3b759ecf404 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] 10.222.0.13 "GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d" status: 200 len: 1314 microversion: 2.1 time: 0.534828 Jun 23 11:45:09.049093 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 95/181] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:08 2022] GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d => generated 1314 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:45:09.059259 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-c2be0186-f93c-444d-9ef2-5778553421ca tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4" status: 200 len: 1368 microversion: 2.1 time: 0.488798 Jun 23 11:45:09.059914 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 87/182] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:08 2022] GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4 => generated 1368 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:45:09.204455 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-9c0f102c-c07c-4669-b8d6-21e41547e801 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:09.204455 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-9c0f102c-c07c-4669-b8d6-21e41547e801 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:09.204660 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-dd1b7652-7208-46a5-9ce0-ffa83eca8031 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:09.204660 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-dd1b7652-7208-46a5-9ce0-ffa83eca8031 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 0953fa06-0916-418f-b527-06d088cc6066] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:09.212197 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-dd1b7652-7208-46a5-9ce0-ffa83eca8031 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:09.212752 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-dd1b7652-7208-46a5-9ce0-ffa83eca8031 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:09.213812 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-dd1b7652-7208-46a5-9ce0-ffa83eca8031 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:09.214500 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-dd1b7652-7208-46a5-9ce0-ffa83eca8031 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:09.226390 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-9c0f102c-c07c-4669-b8d6-21e41547e801 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:09.226865 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-9c0f102c-c07c-4669-b8d6-21e41547e801 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:09.233212 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-9c0f102c-c07c-4669-b8d6-21e41547e801 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:09.233212 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-9c0f102c-c07c-4669-b8d6-21e41547e801 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:09.418994 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-dd1b7652-7208-46a5-9ce0-ffa83eca8031 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:09.422267 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-9c0f102c-c07c-4669-b8d6-21e41547e801 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:09.428235 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-dd1b7652-7208-46a5-9ce0-ffa83eca8031 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066" status: 200 len: 1322 microversion: 2.1 time: 0.228731 Jun 23 11:45:09.429077 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 88/183] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:09 2022] GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066 => generated 1322 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:45:09.435921 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-9c0f102c-c07c-4669-b8d6-21e41547e801 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 200 len: 1364 microversion: 2.1 time: 0.238189 Jun 23 11:45:09.436633 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 96/184] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:09 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 1364 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:45:10.065930 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-ad22a6e9-7753-437e-8873-345e1cbfea2c tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:10.066547 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-ad22a6e9-7753-437e-8873-345e1cbfea2c tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] [instance: 16a06134-ea93-492f-a705-29cc31876c5d] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:10.073066 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ad22a6e9-7753-437e-8873-345e1cbfea2c tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:10.073520 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ad22a6e9-7753-437e-8873-345e1cbfea2c tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:10.074625 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ad22a6e9-7753-437e-8873-345e1cbfea2c tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:10.074807 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ad22a6e9-7753-437e-8873-345e1cbfea2c tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:10.077322 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-745e19a1-9008-47b0-80f6-b25f9937fa5e tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:10.077930 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-745e19a1-9008-47b0-80f6-b25f9937fa5e tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 250e2ce6-70ad-4082-8073-6a9cea0ca1e4] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:10.085200 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-745e19a1-9008-47b0-80f6-b25f9937fa5e tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:10.086232 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-745e19a1-9008-47b0-80f6-b25f9937fa5e tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:10.087906 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-745e19a1-9008-47b0-80f6-b25f9937fa5e tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:10.088738 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-745e19a1-9008-47b0-80f6-b25f9937fa5e tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:10.301408 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-ad22a6e9-7753-437e-8873-345e1cbfea2c tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae72d6c494ba4f16989adfe090803d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515e65a705ee46cc8f8e03efbe58f177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:10.309844 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-ad22a6e9-7753-437e-8873-345e1cbfea2c tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] 10.222.0.13 "GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d" status: 200 len: 1314 microversion: 2.1 time: 0.247460 Jun 23 11:45:10.310438 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 89/185] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:10 2022] GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:45:10.312199 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-745e19a1-9008-47b0-80f6-b25f9937fa5e tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:10.336846 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-745e19a1-9008-47b0-80f6-b25f9937fa5e tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4" status: 200 len: 1368 microversion: 2.1 time: 0.263478 Jun 23 11:45:10.337620 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 97/186] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:10 2022] GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4 => generated 1368 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:45:10.445836 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-7e3fa419-16c0-451c-9366-47df4837526a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:10.446443 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-7e3fa419-16c0-451c-9366-47df4837526a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 0953fa06-0916-418f-b527-06d088cc6066] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:10.452580 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-7e3fa419-16c0-451c-9366-47df4837526a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:10.453025 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-7e3fa419-16c0-451c-9366-47df4837526a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:10.453777 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-7e3fa419-16c0-451c-9366-47df4837526a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:10.454209 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-7e3fa419-16c0-451c-9366-47df4837526a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:10.464180 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-87333379-5650-4be0-9b4f-1925fbfa3264 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:10.464808 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-87333379-5650-4be0-9b4f-1925fbfa3264 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:10.472917 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-87333379-5650-4be0-9b4f-1925fbfa3264 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:10.476347 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-87333379-5650-4be0-9b4f-1925fbfa3264 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:10.477197 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-87333379-5650-4be0-9b4f-1925fbfa3264 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:10.477548 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-87333379-5650-4be0-9b4f-1925fbfa3264 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:10.671995 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-7e3fa419-16c0-451c-9366-47df4837526a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:10.680606 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-7e3fa419-16c0-451c-9366-47df4837526a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066" status: 200 len: 1322 microversion: 2.1 time: 0.238551 Jun 23 11:45:10.681550 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 90/187] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:10 2022] GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066 => generated 1322 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:45:10.683725 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-87333379-5650-4be0-9b4f-1925fbfa3264 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:10.686295 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [req-62d6e6be-bb6b-45c0-b133-8dbf726a58fe req-f1339f68-6d60-40ec-a58a-cb6e4b852c86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "250e2ce6-70ad-4082-8073-6a9cea0ca1e4", "name": "network-vif-plugged", "status": "completed", "tag": "acf9b9ee-0912-476a-bbae-a8fa23161cdb"}]} {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:45:10.691748 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-87333379-5650-4be0-9b4f-1925fbfa3264 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 200 len: 1364 microversion: 2.1 time: 0.231488 Jun 23 11:45:10.692260 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 98/188] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:10 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 1364 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:45:10.695005 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [req-62d6e6be-bb6b-45c0-b133-8dbf726a58fe req-f1339f68-6d60-40ec-a58a-cb6e4b852c86 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:10.697277 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [req-62d6e6be-bb6b-45c0-b133-8dbf726a58fe req-f1339f68-6d60-40ec-a58a-cb6e4b852c86 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:10.715311 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.compute.server_external_events [req-62d6e6be-bb6b-45c0-b133-8dbf726a58fe req-f1339f68-6d60-40ec-a58a-cb6e4b852c86 service nova] Creating event network-vif-plugged:acf9b9ee-0912-476a-bbae-a8fa23161cdb for instance 250e2ce6-70ad-4082-8073-6a9cea0ca1e4 on hv-cinder-82099 Jun 23 11:45:10.720720 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [req-62d6e6be-bb6b-45c0-b133-8dbf726a58fe req-f1339f68-6d60-40ec-a58a-cb6e4b852c86 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037785 Jun 23 11:45:10.723605 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 91/189] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:45:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:45:11.327548 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-05dacb45-477e-4d9a-b458-a6b581ee4429 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:11.328156 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-05dacb45-477e-4d9a-b458-a6b581ee4429 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] [instance: 16a06134-ea93-492f-a705-29cc31876c5d] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:11.335195 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-05dacb45-477e-4d9a-b458-a6b581ee4429 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:11.335637 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-05dacb45-477e-4d9a-b458-a6b581ee4429 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:11.336419 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-05dacb45-477e-4d9a-b458-a6b581ee4429 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:11.336812 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-05dacb45-477e-4d9a-b458-a6b581ee4429 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:11.358907 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-0a6585b1-6e2f-49a5-bccf-2802d46fe0fe tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:11.359601 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-0a6585b1-6e2f-49a5-bccf-2802d46fe0fe tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 250e2ce6-70ad-4082-8073-6a9cea0ca1e4] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:11.368303 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-0a6585b1-6e2f-49a5-bccf-2802d46fe0fe tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:11.368861 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-0a6585b1-6e2f-49a5-bccf-2802d46fe0fe tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:11.369626 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-0a6585b1-6e2f-49a5-bccf-2802d46fe0fe tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:11.370051 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-0a6585b1-6e2f-49a5-bccf-2802d46fe0fe tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:11.557183 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-05dacb45-477e-4d9a-b458-a6b581ee4429 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae72d6c494ba4f16989adfe090803d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515e65a705ee46cc8f8e03efbe58f177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:11.562883 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_cell1:SELECT=100 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:45:11.566746 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-0a6585b1-6e2f-49a5-bccf-2802d46fe0fe tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:11.569157 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-05dacb45-477e-4d9a-b458-a6b581ee4429 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] 10.222.0.13 "GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d" status: 200 len: 1314 microversion: 2.1 time: 0.245395 Jun 23 11:45:11.574568 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 99/190] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:11 2022] GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:45:11.574710 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-0a6585b1-6e2f-49a5-bccf-2802d46fe0fe tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4" status: 200 len: 1368 microversion: 2.1 time: 0.219689 Jun 23 11:45:11.575081 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 92/191] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:11 2022] GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4 => generated 1368 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:45:11.699318 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-5bb4e4ae-688d-40e3-9311-1ed3f428c13d tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:11.700006 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-5bb4e4ae-688d-40e3-9311-1ed3f428c13d tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 0953fa06-0916-418f-b527-06d088cc6066] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:11.714775 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-5bb4e4ae-688d-40e3-9311-1ed3f428c13d tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:11.715336 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-5bb4e4ae-688d-40e3-9311-1ed3f428c13d tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:11.719715 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-5bb4e4ae-688d-40e3-9311-1ed3f428c13d tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:11.719715 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-5bb4e4ae-688d-40e3-9311-1ed3f428c13d tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:11.722694 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-4ce88ea0-792d-49bc-b8a4-24a15c58b1b2 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:11.723616 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-4ce88ea0-792d-49bc-b8a4-24a15c58b1b2 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:11.738833 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-4ce88ea0-792d-49bc-b8a4-24a15c58b1b2 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:11.739357 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-4ce88ea0-792d-49bc-b8a4-24a15c58b1b2 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:11.740156 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-4ce88ea0-792d-49bc-b8a4-24a15c58b1b2 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:11.740783 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-4ce88ea0-792d-49bc-b8a4-24a15c58b1b2 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:11.987806 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-5bb4e4ae-688d-40e3-9311-1ed3f428c13d tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:11.993222 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-4ce88ea0-792d-49bc-b8a4-24a15c58b1b2 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:11.995361 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-5bb4e4ae-688d-40e3-9311-1ed3f428c13d tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066" status: 200 len: 1322 microversion: 2.1 time: 0.301072 Jun 23 11:45:11.996026 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 100/192] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:11 2022] GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066 => generated 1322 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:45:12.004458 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-4ce88ea0-792d-49bc-b8a4-24a15c58b1b2 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 200 len: 1364 microversion: 2.1 time: 0.295177 Jun 23 11:45:12.005035 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 93/193] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:11 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 1364 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:45:12.587341 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-9afac491-8d3f-4e2a-98f4-4cd9eeaec355 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:12.587982 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-9afac491-8d3f-4e2a-98f4-4cd9eeaec355 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] [instance: 16a06134-ea93-492f-a705-29cc31876c5d] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:12.592136 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-9836c211-ea89-4c58-85d2-d45b6ab3c09a tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:12.592747 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-9836c211-ea89-4c58-85d2-d45b6ab3c09a tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 250e2ce6-70ad-4082-8073-6a9cea0ca1e4] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:12.594161 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-9afac491-8d3f-4e2a-98f4-4cd9eeaec355 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:12.594682 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-9afac491-8d3f-4e2a-98f4-4cd9eeaec355 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:12.594789 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_api:SELECT=100 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:45:12.595435 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-9afac491-8d3f-4e2a-98f4-4cd9eeaec355 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:12.596093 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-9afac491-8d3f-4e2a-98f4-4cd9eeaec355 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:12.600675 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-9836c211-ea89-4c58-85d2-d45b6ab3c09a tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:12.601024 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-9836c211-ea89-4c58-85d2-d45b6ab3c09a tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:12.601796 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-9836c211-ea89-4c58-85d2-d45b6ab3c09a tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:12.606846 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-9836c211-ea89-4c58-85d2-d45b6ab3c09a tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:12.806415 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-9afac491-8d3f-4e2a-98f4-4cd9eeaec355 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae72d6c494ba4f16989adfe090803d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515e65a705ee46cc8f8e03efbe58f177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:12.809658 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-9836c211-ea89-4c58-85d2-d45b6ab3c09a tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:12.813915 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-9afac491-8d3f-4e2a-98f4-4cd9eeaec355 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] 10.222.0.13 "GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d" status: 200 len: 1314 microversion: 2.1 time: 0.230591 Jun 23 11:45:12.815400 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 101/194] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:12 2022] GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:45:12.818248 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-9836c211-ea89-4c58-85d2-d45b6ab3c09a tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4" status: 200 len: 1368 microversion: 2.1 time: 0.229999 Jun 23 11:45:12.818851 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 94/195] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:12 2022] GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4 => generated 1368 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:45:13.017064 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-aa32591e-cc17-41fe-a93c-15e5bd829b2f tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:13.017772 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-aa32591e-cc17-41fe-a93c-15e5bd829b2f tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 0953fa06-0916-418f-b527-06d088cc6066] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:13.021637 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-eaaf751e-9ce5-4c91-8d9e-79d04a94d31e tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:13.022334 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-eaaf751e-9ce5-4c91-8d9e-79d04a94d31e tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:13.024693 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-aa32591e-cc17-41fe-a93c-15e5bd829b2f tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:13.025298 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-aa32591e-cc17-41fe-a93c-15e5bd829b2f tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:13.026063 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-aa32591e-cc17-41fe-a93c-15e5bd829b2f tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:13.026490 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-aa32591e-cc17-41fe-a93c-15e5bd829b2f tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:13.029727 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-eaaf751e-9ce5-4c91-8d9e-79d04a94d31e tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:13.029727 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-eaaf751e-9ce5-4c91-8d9e-79d04a94d31e tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:13.030688 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-eaaf751e-9ce5-4c91-8d9e-79d04a94d31e tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:13.033333 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-eaaf751e-9ce5-4c91-8d9e-79d04a94d31e tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:13.035825 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_cell1:SELECT=100 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:45:13.231059 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-aa32591e-cc17-41fe-a93c-15e5bd829b2f tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:13.233934 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-eaaf751e-9ce5-4c91-8d9e-79d04a94d31e tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:13.239951 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-aa32591e-cc17-41fe-a93c-15e5bd829b2f tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066" status: 200 len: 1322 microversion: 2.1 time: 0.226737 Jun 23 11:45:13.240520 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 102/196] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:13 2022] GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066 => generated 1322 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:45:13.242086 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-eaaf751e-9ce5-4c91-8d9e-79d04a94d31e tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 200 len: 1364 microversion: 2.1 time: 0.225082 Jun 23 11:45:13.242673 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 95/197] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:13 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 1364 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:45:13.988376 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-8317942d-6971-4d42-b0a0-e5c981b9ca23 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:13.988376 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-8317942d-6971-4d42-b0a0-e5c981b9ca23 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] [instance: 16a06134-ea93-492f-a705-29cc31876c5d] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:13.990855 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-b76ced6f-cd47-4dfd-8ba9-cda4ab803f21 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:13.990855 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-b76ced6f-cd47-4dfd-8ba9-cda4ab803f21 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 250e2ce6-70ad-4082-8073-6a9cea0ca1e4] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:13.992194 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-8317942d-6971-4d42-b0a0-e5c981b9ca23 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:13.992194 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-8317942d-6971-4d42-b0a0-e5c981b9ca23 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:13.992194 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-8317942d-6971-4d42-b0a0-e5c981b9ca23 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:13.992194 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-8317942d-6971-4d42-b0a0-e5c981b9ca23 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:13.992932 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-b76ced6f-cd47-4dfd-8ba9-cda4ab803f21 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:13.992932 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-b76ced6f-cd47-4dfd-8ba9-cda4ab803f21 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:13.992932 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-b76ced6f-cd47-4dfd-8ba9-cda4ab803f21 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:13.992932 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-b76ced6f-cd47-4dfd-8ba9-cda4ab803f21 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:14.037127 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-8317942d-6971-4d42-b0a0-e5c981b9ca23 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae72d6c494ba4f16989adfe090803d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515e65a705ee46cc8f8e03efbe58f177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:14.045093 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-8317942d-6971-4d42-b0a0-e5c981b9ca23 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] 10.222.0.13 "GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d" status: 200 len: 1314 microversion: 2.1 time: 0.217129 Jun 23 11:45:14.046159 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 103/198] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:13 2022] GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:45:14.067483 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-b76ced6f-cd47-4dfd-8ba9-cda4ab803f21 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:14.067483 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-b76ced6f-cd47-4dfd-8ba9-cda4ab803f21 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4" status: 200 len: 1368 microversion: 2.1 time: 0.224733 Jun 23 11:45:14.067483 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 96/199] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:13 2022] GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4 => generated 1368 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:45:14.259091 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-2d1e6d9e-1ea2-4fde-9ba2-0ba0c3c334dc tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:14.259297 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-eb9a8c44-27a7-4edb-a581-f2a79abb0e9c tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:14.259614 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-eb9a8c44-27a7-4edb-a581-f2a79abb0e9c tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 0953fa06-0916-418f-b527-06d088cc6066] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:14.259714 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-2d1e6d9e-1ea2-4fde-9ba2-0ba0c3c334dc tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:14.265909 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-eb9a8c44-27a7-4edb-a581-f2a79abb0e9c tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:14.266279 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-2d1e6d9e-1ea2-4fde-9ba2-0ba0c3c334dc tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:14.266469 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-eb9a8c44-27a7-4edb-a581-f2a79abb0e9c tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:14.267218 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-2d1e6d9e-1ea2-4fde-9ba2-0ba0c3c334dc tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:14.267362 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-eb9a8c44-27a7-4edb-a581-f2a79abb0e9c tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:14.267829 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-eb9a8c44-27a7-4edb-a581-f2a79abb0e9c tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:14.268019 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-2d1e6d9e-1ea2-4fde-9ba2-0ba0c3c334dc tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:14.268648 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-2d1e6d9e-1ea2-4fde-9ba2-0ba0c3c334dc tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:14.654505 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-2d1e6d9e-1ea2-4fde-9ba2-0ba0c3c334dc tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:14.658886 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-eb9a8c44-27a7-4edb-a581-f2a79abb0e9c tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:14.663125 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-2d1e6d9e-1ea2-4fde-9ba2-0ba0c3c334dc tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 200 len: 1364 microversion: 2.1 time: 0.407865 Jun 23 11:45:14.663789 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 97/200] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:14 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 1364 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:45:14.666966 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-eb9a8c44-27a7-4edb-a581-f2a79abb0e9c tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066" status: 200 len: 1322 microversion: 2.1 time: 0.411984 Jun 23 11:45:14.667511 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 104/201] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:14 2022] GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066 => generated 1322 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:45:15.083148 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-71253996-cea6-4d2f-ab94-5fbe192ac6f1 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:15.083821 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-91419b22-2ab6-4e82-924e-3ea17fe9e0d1 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:15.084444 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-71253996-cea6-4d2f-ab94-5fbe192ac6f1 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 250e2ce6-70ad-4082-8073-6a9cea0ca1e4] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:15.088258 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-91419b22-2ab6-4e82-924e-3ea17fe9e0d1 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] [instance: 16a06134-ea93-492f-a705-29cc31876c5d] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:15.091539 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-71253996-cea6-4d2f-ab94-5fbe192ac6f1 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:15.092010 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-91419b22-2ab6-4e82-924e-3ea17fe9e0d1 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:15.092122 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-91419b22-2ab6-4e82-924e-3ea17fe9e0d1 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:15.092350 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-71253996-cea6-4d2f-ab94-5fbe192ac6f1 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:15.092913 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-91419b22-2ab6-4e82-924e-3ea17fe9e0d1 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:15.093327 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-71253996-cea6-4d2f-ab94-5fbe192ac6f1 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:15.093418 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-91419b22-2ab6-4e82-924e-3ea17fe9e0d1 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:15.093932 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-71253996-cea6-4d2f-ab94-5fbe192ac6f1 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:15.288002 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-91419b22-2ab6-4e82-924e-3ea17fe9e0d1 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae72d6c494ba4f16989adfe090803d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515e65a705ee46cc8f8e03efbe58f177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:15.295163 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-71253996-cea6-4d2f-ab94-5fbe192ac6f1 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:15.296325 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-91419b22-2ab6-4e82-924e-3ea17fe9e0d1 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] 10.222.0.13 "GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d" status: 200 len: 1314 microversion: 2.1 time: 0.217007 Jun 23 11:45:15.302571 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 98/202] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:15 2022] GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:45:15.303348 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-71253996-cea6-4d2f-ab94-5fbe192ac6f1 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4" status: 200 len: 1368 microversion: 2.1 time: 0.224040 Jun 23 11:45:15.303903 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 105/203] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:15 2022] GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4 => generated 1368 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:45:15.681488 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-1afe6334-ace8-4761-bc46-78a4c6159c14 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:15.682085 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-1afe6334-ace8-4761-bc46-78a4c6159c14 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:15.685638 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-9bc822de-e267-4311-b323-6da0ec7b83a3 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:15.686246 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-9bc822de-e267-4311-b323-6da0ec7b83a3 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 0953fa06-0916-418f-b527-06d088cc6066] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:15.688413 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-1afe6334-ace8-4761-bc46-78a4c6159c14 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:15.688859 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-1afe6334-ace8-4761-bc46-78a4c6159c14 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:15.689608 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-1afe6334-ace8-4761-bc46-78a4c6159c14 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:15.690032 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-1afe6334-ace8-4761-bc46-78a4c6159c14 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:15.692596 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-9bc822de-e267-4311-b323-6da0ec7b83a3 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:15.696130 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-9bc822de-e267-4311-b323-6da0ec7b83a3 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:15.696130 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-9bc822de-e267-4311-b323-6da0ec7b83a3 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:15.696130 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-9bc822de-e267-4311-b323-6da0ec7b83a3 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:15.886258 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-1afe6334-ace8-4761-bc46-78a4c6159c14 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:15.890200 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-9bc822de-e267-4311-b323-6da0ec7b83a3 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:15.893976 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-1afe6334-ace8-4761-bc46-78a4c6159c14 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 200 len: 1364 microversion: 2.1 time: 0.216539 Jun 23 11:45:15.895057 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 99/204] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:15 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 1364 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:45:15.901397 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-9bc822de-e267-4311-b323-6da0ec7b83a3 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066" status: 200 len: 1322 microversion: 2.1 time: 0.221232 Jun 23 11:45:15.902059 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 106/205] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:15 2022] GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066 => generated 1322 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:45:16.313182 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-db30aa9e-e097-422e-9f46-ea27e0a19860 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:16.313912 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-db30aa9e-e097-422e-9f46-ea27e0a19860 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] [instance: 16a06134-ea93-492f-a705-29cc31876c5d] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:16.320291 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-db30aa9e-e097-422e-9f46-ea27e0a19860 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:16.320468 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-a2d8fc4f-d33a-46b8-8e22-869477a7e7e1 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:16.320889 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-db30aa9e-e097-422e-9f46-ea27e0a19860 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:16.321119 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-a2d8fc4f-d33a-46b8-8e22-869477a7e7e1 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 250e2ce6-70ad-4082-8073-6a9cea0ca1e4] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:16.321470 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-db30aa9e-e097-422e-9f46-ea27e0a19860 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:16.321908 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-db30aa9e-e097-422e-9f46-ea27e0a19860 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:16.327088 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a2d8fc4f-d33a-46b8-8e22-869477a7e7e1 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:16.327530 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a2d8fc4f-d33a-46b8-8e22-869477a7e7e1 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:16.328272 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a2d8fc4f-d33a-46b8-8e22-869477a7e7e1 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:16.328698 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a2d8fc4f-d33a-46b8-8e22-869477a7e7e1 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:16.532083 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-db30aa9e-e097-422e-9f46-ea27e0a19860 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae72d6c494ba4f16989adfe090803d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515e65a705ee46cc8f8e03efbe58f177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:16.538087 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-a2d8fc4f-d33a-46b8-8e22-869477a7e7e1 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:16.540594 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-db30aa9e-e097-422e-9f46-ea27e0a19860 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] 10.222.0.13 "GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d" status: 200 len: 1314 microversion: 2.1 time: 0.231252 Jun 23 11:45:16.541195 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 100/206] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:16 2022] GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:45:16.542299 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-a2d8fc4f-d33a-46b8-8e22-869477a7e7e1 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4" status: 200 len: 1368 microversion: 2.1 time: 0.226081 Jun 23 11:45:16.542883 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 107/207] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:16 2022] GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4 => generated 1368 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:45:16.910998 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-1e448b03-9a1e-4aa6-abc8-17b06d51b370 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:16.911608 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-1e448b03-9a1e-4aa6-abc8-17b06d51b370 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:16.917674 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-1e448b03-9a1e-4aa6-abc8-17b06d51b370 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:16.918118 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-1e448b03-9a1e-4aa6-abc8-17b06d51b370 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:16.918686 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-38d7512d-80e8-46d4-8174-66489c8b26ed tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:16.918895 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-1e448b03-9a1e-4aa6-abc8-17b06d51b370 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:16.919288 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-38d7512d-80e8-46d4-8174-66489c8b26ed tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 0953fa06-0916-418f-b527-06d088cc6066] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:16.919386 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-1e448b03-9a1e-4aa6-abc8-17b06d51b370 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:16.925757 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-38d7512d-80e8-46d4-8174-66489c8b26ed tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:16.926738 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-38d7512d-80e8-46d4-8174-66489c8b26ed tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:16.927516 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-38d7512d-80e8-46d4-8174-66489c8b26ed tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:16.927941 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-38d7512d-80e8-46d4-8174-66489c8b26ed tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:17.116947 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-1e448b03-9a1e-4aa6-abc8-17b06d51b370 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:17.123990 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-38d7512d-80e8-46d4-8174-66489c8b26ed tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:17.124386 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-1e448b03-9a1e-4aa6-abc8-17b06d51b370 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 200 len: 1364 microversion: 2.1 time: 0.217374 Jun 23 11:45:17.125160 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 101/208] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:16 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 1364 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:45:17.132541 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-38d7512d-80e8-46d4-8174-66489c8b26ed tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066" status: 200 len: 1322 microversion: 2.1 time: 0.217727 Jun 23 11:45:17.133188 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 108/209] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:16 2022] GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066 => generated 1322 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:45:17.557566 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-f5888346-3748-4bce-af41-e981d4eb11f9 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:17.558175 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-f5888346-3748-4bce-af41-e981d4eb11f9 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] [instance: 16a06134-ea93-492f-a705-29cc31876c5d] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:17.559096 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-d8ee7d3b-71a9-4737-8a51-7a4fc403770f tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:17.559709 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-d8ee7d3b-71a9-4737-8a51-7a4fc403770f tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 250e2ce6-70ad-4082-8073-6a9cea0ca1e4] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:17.564220 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-f5888346-3748-4bce-af41-e981d4eb11f9 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:17.564665 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-f5888346-3748-4bce-af41-e981d4eb11f9 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:17.565450 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-f5888346-3748-4bce-af41-e981d4eb11f9 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:17.565678 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-d8ee7d3b-71a9-4737-8a51-7a4fc403770f tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:17.566203 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-d8ee7d3b-71a9-4737-8a51-7a4fc403770f tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:17.566331 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-f5888346-3748-4bce-af41-e981d4eb11f9 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:17.566990 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-d8ee7d3b-71a9-4737-8a51-7a4fc403770f tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:17.567422 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-d8ee7d3b-71a9-4737-8a51-7a4fc403770f tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:17.773322 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-f5888346-3748-4bce-af41-e981d4eb11f9 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae72d6c494ba4f16989adfe090803d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515e65a705ee46cc8f8e03efbe58f177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:17.776621 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-d8ee7d3b-71a9-4737-8a51-7a4fc403770f tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:17.780774 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-f5888346-3748-4bce-af41-e981d4eb11f9 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] 10.222.0.13 "GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d" status: 200 len: 1314 microversion: 2.1 time: 0.227142 Jun 23 11:45:17.781737 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 102/210] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:17 2022] GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:45:17.795671 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-d8ee7d3b-71a9-4737-8a51-7a4fc403770f tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4" status: 200 len: 1368 microversion: 2.1 time: 0.240425 Jun 23 11:45:17.796249 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 109/211] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:17 2022] GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4 => generated 1368 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:45:18.141975 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-50fa28a4-a4f7-4802-8821-bc2fdf756cb2 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:18.142602 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-50fa28a4-a4f7-4802-8821-bc2fdf756cb2 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:18.150513 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-13fbbf53-3067-4597-90f3-c900bf22f3b1 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:18.150725 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-50fa28a4-a4f7-4802-8821-bc2fdf756cb2 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:18.150962 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-50fa28a4-a4f7-4802-8821-bc2fdf756cb2 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:18.151073 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-13fbbf53-3067-4597-90f3-c900bf22f3b1 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 0953fa06-0916-418f-b527-06d088cc6066] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:18.152112 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-50fa28a4-a4f7-4802-8821-bc2fdf756cb2 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:18.152225 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-50fa28a4-a4f7-4802-8821-bc2fdf756cb2 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:18.157250 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-13fbbf53-3067-4597-90f3-c900bf22f3b1 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:18.157697 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-13fbbf53-3067-4597-90f3-c900bf22f3b1 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:18.160648 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-13fbbf53-3067-4597-90f3-c900bf22f3b1 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:18.160648 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-13fbbf53-3067-4597-90f3-c900bf22f3b1 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:18.380760 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-50fa28a4-a4f7-4802-8821-bc2fdf756cb2 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:18.389705 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-50fa28a4-a4f7-4802-8821-bc2fdf756cb2 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 200 len: 1364 microversion: 2.1 time: 0.251379 Jun 23 11:45:18.393889 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 103/212] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:18 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 1364 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:45:18.396421 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-13fbbf53-3067-4597-90f3-c900bf22f3b1 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:18.403938 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-13fbbf53-3067-4597-90f3-c900bf22f3b1 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066" status: 200 len: 1322 microversion: 2.1 time: 0.257413 Jun 23 11:45:18.404570 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 110/213] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:18 2022] GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066 => generated 1322 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:45:18.797999 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-965ed858-7552-422d-bdc7-29d685be8c7c tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:18.798635 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-965ed858-7552-422d-bdc7-29d685be8c7c tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] [instance: 16a06134-ea93-492f-a705-29cc31876c5d] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:18.805526 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-965ed858-7552-422d-bdc7-29d685be8c7c tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:18.809544 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-965ed858-7552-422d-bdc7-29d685be8c7c tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:18.809544 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-965ed858-7552-422d-bdc7-29d685be8c7c tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:18.809544 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-965ed858-7552-422d-bdc7-29d685be8c7c tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:18.812746 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-928e06bc-c0eb-433f-84db-aaaf2c2fc76d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:18.813937 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-928e06bc-c0eb-433f-84db-aaaf2c2fc76d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 250e2ce6-70ad-4082-8073-6a9cea0ca1e4] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:18.820684 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-928e06bc-c0eb-433f-84db-aaaf2c2fc76d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:18.821261 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-928e06bc-c0eb-433f-84db-aaaf2c2fc76d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:18.822328 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-928e06bc-c0eb-433f-84db-aaaf2c2fc76d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:18.822979 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-928e06bc-c0eb-433f-84db-aaaf2c2fc76d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:19.022213 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-965ed858-7552-422d-bdc7-29d685be8c7c tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae72d6c494ba4f16989adfe090803d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515e65a705ee46cc8f8e03efbe58f177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:19.032781 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-965ed858-7552-422d-bdc7-29d685be8c7c tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] 10.222.0.13 "GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d" status: 200 len: 1501 microversion: 2.1 time: 0.237657 Jun 23 11:45:19.041819 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-928e06bc-c0eb-433f-84db-aaaf2c2fc76d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:19.042726 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 104/214] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:18 2022] GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d => generated 1501 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:45:19.053816 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-928e06bc-c0eb-433f-84db-aaaf2c2fc76d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4" status: 200 len: 1368 microversion: 2.1 time: 0.244983 Jun 23 11:45:19.065075 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 111/215] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:18 2022] GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4 => generated 1368 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:45:19.407985 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-491580be-ccdd-4287-8fce-5b85090c93ff tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:19.408630 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-491580be-ccdd-4287-8fce-5b85090c93ff tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:19.416343 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-491580be-ccdd-4287-8fce-5b85090c93ff tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:19.421221 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-491580be-ccdd-4287-8fce-5b85090c93ff tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:19.421221 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-491580be-ccdd-4287-8fce-5b85090c93ff tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:19.421221 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-491580be-ccdd-4287-8fce-5b85090c93ff tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:19.421462 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-00242bc1-4638-4ed8-80e3-00077c467a3a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:19.421637 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-00242bc1-4638-4ed8-80e3-00077c467a3a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 0953fa06-0916-418f-b527-06d088cc6066] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:19.429753 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-00242bc1-4638-4ed8-80e3-00077c467a3a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:19.430198 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-00242bc1-4638-4ed8-80e3-00077c467a3a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:19.431046 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-00242bc1-4638-4ed8-80e3-00077c467a3a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:19.431503 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-00242bc1-4638-4ed8-80e3-00077c467a3a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:19.659114 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-491580be-ccdd-4287-8fce-5b85090c93ff tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:19.663818 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-00242bc1-4638-4ed8-80e3-00077c467a3a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:19.667757 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-491580be-ccdd-4287-8fce-5b85090c93ff tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 200 len: 1364 microversion: 2.1 time: 0.263612 Jun 23 11:45:19.668558 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 105/216] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:19 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 1364 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:45:19.671653 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-00242bc1-4638-4ed8-80e3-00077c467a3a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066" status: 200 len: 1516 microversion: 2.1 time: 0.254544 Jun 23 11:45:19.672225 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 112/217] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:19 2022] GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066 => generated 1516 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:45:19.691241 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-9cb94e15-954e-409c-b97d-1d90f835f57b tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:45:19.692501 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-9cb94e15-954e-409c-b97d-1d90f835f57b tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 0953fa06-0916-418f-b527-06d088cc6066] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:19.699418 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-9cb94e15-954e-409c-b97d-1d90f835f57b tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:19.700186 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-9cb94e15-954e-409c-b97d-1d90f835f57b tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:19.700883 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-9cb94e15-954e-409c-b97d-1d90f835f57b tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:19.701312 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-9cb94e15-954e-409c-b97d-1d90f835f57b tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:19.764437 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.objects.instance [None req-9cb94e15-954e-409c-b97d-1d90f835f57b tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lazy-loading 'flavor' on Instance uuid 0953fa06-0916-418f-b527-06d088cc6066 {{(pid=124669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:45:20.071051 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-b179adcb-185f-4768-a744-3746925cb4e4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:20.071655 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-b179adcb-185f-4768-a744-3746925cb4e4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 250e2ce6-70ad-4082-8073-6a9cea0ca1e4] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:20.077666 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-b179adcb-185f-4768-a744-3746925cb4e4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:20.078109 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-b179adcb-185f-4768-a744-3746925cb4e4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:20.078910 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-b179adcb-185f-4768-a744-3746925cb4e4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:20.079340 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-b179adcb-185f-4768-a744-3746925cb4e4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:20.201011 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-9cb94e15-954e-409c-b97d-1d90f835f57b tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "POST /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066/action" status: 200 len: 32 microversion: 2.1 time: 0.515411 Jun 23 11:45:20.205931 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 106/218] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Jun 23 11:45:19 2022] POST /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066/action => generated 32 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 11:45:20.212696 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-f6c95d01-754c-4cb5-916f-4cca4d1a6ea0 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:20.213514 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-f6c95d01-754c-4cb5-916f-4cca4d1a6ea0 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 0953fa06-0916-418f-b527-06d088cc6066] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:20.216616 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-b179adcb-185f-4768-a744-3746925cb4e4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:20.223730 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-f6c95d01-754c-4cb5-916f-4cca4d1a6ea0 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:20.224208 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-f6c95d01-754c-4cb5-916f-4cca4d1a6ea0 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:20.228667 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-f6c95d01-754c-4cb5-916f-4cca4d1a6ea0 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:20.228667 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-f6c95d01-754c-4cb5-916f-4cca4d1a6ea0 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:20.228844 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-b179adcb-185f-4768-a744-3746925cb4e4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4" status: 200 len: 1368 microversion: 2.1 time: 0.161184 Jun 23 11:45:20.229216 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 113/219] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:20 2022] GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4 => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:45:20.357477 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-f6c95d01-754c-4cb5-916f-4cca4d1a6ea0 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:20.365625 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-f6c95d01-754c-4cb5-916f-4cca4d1a6ea0 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066" status: 200 len: 1522 microversion: 2.1 time: 0.157519 Jun 23 11:45:20.366210 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 107/220] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:20 2022] GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:45:20.685333 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-74946c1c-da02-40ac-80d8-753b66a6dc98 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:20.686053 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-74946c1c-da02-40ac-80d8-753b66a6dc98 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:20.692942 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-74946c1c-da02-40ac-80d8-753b66a6dc98 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:20.693412 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-74946c1c-da02-40ac-80d8-753b66a6dc98 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:20.694322 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-74946c1c-da02-40ac-80d8-753b66a6dc98 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:20.694827 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-74946c1c-da02-40ac-80d8-753b66a6dc98 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:20.828756 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-74946c1c-da02-40ac-80d8-753b66a6dc98 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:20.836986 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-74946c1c-da02-40ac-80d8-753b66a6dc98 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 200 len: 1364 microversion: 2.1 time: 0.155852 Jun 23 11:45:20.837549 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 114/221] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:20 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:45:21.018039 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-aa237501-e1a1-4f24-8f38-30a6a32134eb tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "327529ec-ffe8-4ea1-abee-7255ddb437c8"}} {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:45:21.019908 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-aa237501-e1a1-4f24-8f38-30a6a32134eb tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] [instance: 16a06134-ea93-492f-a705-29cc31876c5d] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:21.026041 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-aa237501-e1a1-4f24-8f38-30a6a32134eb tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:21.026491 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-aa237501-e1a1-4f24-8f38-30a6a32134eb tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:21.035578 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-aa237501-e1a1-4f24-8f38-30a6a32134eb tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:21.035578 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-aa237501-e1a1-4f24-8f38-30a6a32134eb tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:21.261868 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-ff817941-feea-492e-8658-53638c70ec00 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:21.261868 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-ff817941-feea-492e-8658-53638c70ec00 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 250e2ce6-70ad-4082-8073-6a9cea0ca1e4] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:21.270176 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-ff817941-feea-492e-8658-53638c70ec00 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:21.270641 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-ff817941-feea-492e-8658-53638c70ec00 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:21.271690 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-ff817941-feea-492e-8658-53638c70ec00 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:21.272123 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-ff817941-feea-492e-8658-53638c70ec00 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:21.432668 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-ff817941-feea-492e-8658-53638c70ec00 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:21.440243 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-ff817941-feea-492e-8658-53638c70ec00 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4" status: 200 len: 1368 microversion: 2.1 time: 0.195743 Jun 23 11:45:21.441637 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 115/222] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:21 2022] GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4 => generated 1368 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:45:21.446214 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-637922f1-a07f-4e9e-a625-ce24bab420f1 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:21.446851 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-637922f1-a07f-4e9e-a625-ce24bab420f1 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 0953fa06-0916-418f-b527-06d088cc6066] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:21.452931 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-637922f1-a07f-4e9e-a625-ce24bab420f1 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:21.453381 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-637922f1-a07f-4e9e-a625-ce24bab420f1 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:21.454141 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-637922f1-a07f-4e9e-a625-ce24bab420f1 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:21.454598 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-637922f1-a07f-4e9e-a625-ce24bab420f1 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:21.473400 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_cell1:SELECT=100 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:45:21.582880 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-637922f1-a07f-4e9e-a625-ce24bab420f1 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:21.590559 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-637922f1-a07f-4e9e-a625-ce24bab420f1 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066" status: 200 len: 1522 microversion: 2.1 time: 0.148062 Jun 23 11:45:21.591153 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 116/223] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:21 2022] GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:45:21.853687 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-492dca26-8617-4f32-99fd-b9e51a354524 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:21.854459 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-492dca26-8617-4f32-99fd-b9e51a354524 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:21.860575 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-492dca26-8617-4f32-99fd-b9e51a354524 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:21.861016 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-492dca26-8617-4f32-99fd-b9e51a354524 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:21.861790 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-492dca26-8617-4f32-99fd-b9e51a354524 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:21.862258 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-492dca26-8617-4f32-99fd-b9e51a354524 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:21.993979 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-492dca26-8617-4f32-99fd-b9e51a354524 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:22.001232 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-492dca26-8617-4f32-99fd-b9e51a354524 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 200 len: 1364 microversion: 2.1 time: 0.151489 Jun 23 11:45:22.001791 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 117/224] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:21 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:45:22.457525 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-8836af68-afa0-4d3e-868e-2a6c073e563b tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:22.458129 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-8836af68-afa0-4d3e-868e-2a6c073e563b tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 250e2ce6-70ad-4082-8073-6a9cea0ca1e4] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:22.464600 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-8836af68-afa0-4d3e-868e-2a6c073e563b tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:22.465036 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-8836af68-afa0-4d3e-868e-2a6c073e563b tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:22.465777 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-8836af68-afa0-4d3e-868e-2a6c073e563b tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:22.466204 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-8836af68-afa0-4d3e-868e-2a6c073e563b tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:22.599806 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-8836af68-afa0-4d3e-868e-2a6c073e563b tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:22.608621 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-8836af68-afa0-4d3e-868e-2a6c073e563b tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4" status: 200 len: 1368 microversion: 2.1 time: 0.155344 Jun 23 11:45:22.609196 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 118/225] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:22 2022] GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4 => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:45:22.614225 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-4ea76544-e781-4018-9d7d-e8fc07e99e32 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:22.618080 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-4ea76544-e781-4018-9d7d-e8fc07e99e32 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 0953fa06-0916-418f-b527-06d088cc6066] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:22.621275 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-4ea76544-e781-4018-9d7d-e8fc07e99e32 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:22.621752 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-4ea76544-e781-4018-9d7d-e8fc07e99e32 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:22.622525 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-4ea76544-e781-4018-9d7d-e8fc07e99e32 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:22.622971 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-4ea76544-e781-4018-9d7d-e8fc07e99e32 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:22.753632 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-4ea76544-e781-4018-9d7d-e8fc07e99e32 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:22.761238 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-4ea76544-e781-4018-9d7d-e8fc07e99e32 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066" status: 200 len: 1522 microversion: 2.1 time: 0.151067 Jun 23 11:45:22.761801 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 119/226] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:22 2022] GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:45:23.018369 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-41af38bb-3121-4327-8745-7b70a2cfacca tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:23.021138 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-41af38bb-3121-4327-8745-7b70a2cfacca tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:23.026246 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-41af38bb-3121-4327-8745-7b70a2cfacca tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:23.026727 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-41af38bb-3121-4327-8745-7b70a2cfacca tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:23.027474 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-41af38bb-3121-4327-8745-7b70a2cfacca tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:23.027903 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-41af38bb-3121-4327-8745-7b70a2cfacca tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:23.197952 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-41af38bb-3121-4327-8745-7b70a2cfacca tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:23.205304 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-41af38bb-3121-4327-8745-7b70a2cfacca tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 200 len: 1364 microversion: 2.1 time: 0.190736 Jun 23 11:45:23.205867 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 120/227] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:23 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 1364 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:45:23.625185 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-dc43d920-f141-4782-b171-1bf35a2fddcc tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:23.625815 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-dc43d920-f141-4782-b171-1bf35a2fddcc tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 250e2ce6-70ad-4082-8073-6a9cea0ca1e4] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:23.632564 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-dc43d920-f141-4782-b171-1bf35a2fddcc tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:23.633184 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-dc43d920-f141-4782-b171-1bf35a2fddcc tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:23.633937 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-dc43d920-f141-4782-b171-1bf35a2fddcc tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:23.634361 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-dc43d920-f141-4782-b171-1bf35a2fddcc tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:23.766230 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-dc43d920-f141-4782-b171-1bf35a2fddcc tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:23.773870 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-dc43d920-f141-4782-b171-1bf35a2fddcc tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4" status: 200 len: 1368 microversion: 2.1 time: 0.152443 Jun 23 11:45:23.774441 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 121/228] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:23 2022] GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:45:23.779091 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-fbcce6ca-14c4-4c71-ac2f-f0c462c93caf tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:23.779716 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-fbcce6ca-14c4-4c71-ac2f-f0c462c93caf tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 0953fa06-0916-418f-b527-06d088cc6066] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:23.785712 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-fbcce6ca-14c4-4c71-ac2f-f0c462c93caf tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:23.786250 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-fbcce6ca-14c4-4c71-ac2f-f0c462c93caf tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:23.787114 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-fbcce6ca-14c4-4c71-ac2f-f0c462c93caf tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:23.787618 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-fbcce6ca-14c4-4c71-ac2f-f0c462c93caf tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:23.920826 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-fbcce6ca-14c4-4c71-ac2f-f0c462c93caf tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:23.929906 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-fbcce6ca-14c4-4c71-ac2f-f0c462c93caf tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066" status: 200 len: 1522 microversion: 2.1 time: 0.154449 Jun 23 11:45:23.930476 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 122/229] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:23 2022] GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:45:24.223532 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-f9c94816-ed4f-4a62-b660-5a5c73cacded tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:24.224143 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-f9c94816-ed4f-4a62-b660-5a5c73cacded tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:24.229970 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-f9c94816-ed4f-4a62-b660-5a5c73cacded tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:24.230416 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-f9c94816-ed4f-4a62-b660-5a5c73cacded tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:24.231369 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-f9c94816-ed4f-4a62-b660-5a5c73cacded tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:24.231851 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-f9c94816-ed4f-4a62-b660-5a5c73cacded tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:24.364647 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-f9c94816-ed4f-4a62-b660-5a5c73cacded tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:24.372581 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-f9c94816-ed4f-4a62-b660-5a5c73cacded tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 200 len: 1364 microversion: 2.1 time: 0.153359 Jun 23 11:45:24.373503 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 123/230] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:24 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:45:24.790436 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-59bb5e88-89b4-4383-9cf3-c15779c56f2d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:24.791091 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-59bb5e88-89b4-4383-9cf3-c15779c56f2d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 250e2ce6-70ad-4082-8073-6a9cea0ca1e4] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:24.797103 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-59bb5e88-89b4-4383-9cf3-c15779c56f2d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:24.797565 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-59bb5e88-89b4-4383-9cf3-c15779c56f2d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:24.798331 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-59bb5e88-89b4-4383-9cf3-c15779c56f2d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:24.798791 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-59bb5e88-89b4-4383-9cf3-c15779c56f2d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:24.929747 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-59bb5e88-89b4-4383-9cf3-c15779c56f2d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:24.937166 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-59bb5e88-89b4-4383-9cf3-c15779c56f2d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4" status: 200 len: 1368 microversion: 2.1 time: 0.150664 Jun 23 11:45:24.937818 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 124/231] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:24 2022] GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:45:24.946151 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-e405c56d-0a12-4e0b-9818-792e0c3a39ce tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:24.946935 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-e405c56d-0a12-4e0b-9818-792e0c3a39ce tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 0953fa06-0916-418f-b527-06d088cc6066] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:24.952705 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-e405c56d-0a12-4e0b-9818-792e0c3a39ce tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:24.953146 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-e405c56d-0a12-4e0b-9818-792e0c3a39ce tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:24.953890 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-e405c56d-0a12-4e0b-9818-792e0c3a39ce tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:24.954317 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-e405c56d-0a12-4e0b-9818-792e0c3a39ce tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:25.085479 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-e405c56d-0a12-4e0b-9818-792e0c3a39ce tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:25.092971 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-e405c56d-0a12-4e0b-9818-792e0c3a39ce tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066" status: 200 len: 1522 microversion: 2.1 time: 0.150287 Jun 23 11:45:25.093529 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 125/232] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:24 2022] GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:45:25.389396 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-8e4d2ae7-7138-4d75-b7c6-f2ebcf17b894 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:25.390008 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-8e4d2ae7-7138-4d75-b7c6-f2ebcf17b894 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:25.396087 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-8e4d2ae7-7138-4d75-b7c6-f2ebcf17b894 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:25.396535 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-8e4d2ae7-7138-4d75-b7c6-f2ebcf17b894 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:25.397294 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-8e4d2ae7-7138-4d75-b7c6-f2ebcf17b894 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:25.397894 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-8e4d2ae7-7138-4d75-b7c6-f2ebcf17b894 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:25.537031 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-8e4d2ae7-7138-4d75-b7c6-f2ebcf17b894 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:25.544758 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-8e4d2ae7-7138-4d75-b7c6-f2ebcf17b894 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 200 len: 1364 microversion: 2.1 time: 0.159110 Jun 23 11:45:25.545328 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 126/233] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:25 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:45:25.954843 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-297cf02f-8a5b-48ee-9aa2-c55849759681 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:25.955615 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-297cf02f-8a5b-48ee-9aa2-c55849759681 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 250e2ce6-70ad-4082-8073-6a9cea0ca1e4] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:25.961762 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-297cf02f-8a5b-48ee-9aa2-c55849759681 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:25.962208 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-297cf02f-8a5b-48ee-9aa2-c55849759681 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:25.962998 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-297cf02f-8a5b-48ee-9aa2-c55849759681 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:25.963435 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-297cf02f-8a5b-48ee-9aa2-c55849759681 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:26.094802 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-297cf02f-8a5b-48ee-9aa2-c55849759681 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:26.102458 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-297cf02f-8a5b-48ee-9aa2-c55849759681 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4" status: 200 len: 1368 microversion: 2.1 time: 0.151402 Jun 23 11:45:26.103065 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 127/234] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:25 2022] GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:45:26.109141 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-30ca9c70-08ad-40af-90ed-b77c995ab3b6 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:26.110392 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-30ca9c70-08ad-40af-90ed-b77c995ab3b6 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 0953fa06-0916-418f-b527-06d088cc6066] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:26.118263 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-30ca9c70-08ad-40af-90ed-b77c995ab3b6 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:26.118263 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-30ca9c70-08ad-40af-90ed-b77c995ab3b6 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:26.118263 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-30ca9c70-08ad-40af-90ed-b77c995ab3b6 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:26.118755 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-30ca9c70-08ad-40af-90ed-b77c995ab3b6 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:26.252363 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-30ca9c70-08ad-40af-90ed-b77c995ab3b6 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:26.260509 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-30ca9c70-08ad-40af-90ed-b77c995ab3b6 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066" status: 200 len: 1522 microversion: 2.1 time: 0.155195 Jun 23 11:45:26.261074 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 128/235] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:26 2022] GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:45:26.561592 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-33460376-cc7f-4ca1-8c01-14ad814ea93c tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:26.562203 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-33460376-cc7f-4ca1-8c01-14ad814ea93c tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:26.568762 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-33460376-cc7f-4ca1-8c01-14ad814ea93c tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:26.569211 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-33460376-cc7f-4ca1-8c01-14ad814ea93c tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:26.569970 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-33460376-cc7f-4ca1-8c01-14ad814ea93c tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:26.570404 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-33460376-cc7f-4ca1-8c01-14ad814ea93c tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:26.708554 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-33460376-cc7f-4ca1-8c01-14ad814ea93c tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:26.716391 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-33460376-cc7f-4ca1-8c01-14ad814ea93c tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 200 len: 1364 microversion: 2.1 time: 0.158609 Jun 23 11:45:26.716945 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 129/236] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:26 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:45:27.126267 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-ed932821-c826-45f8-b9ef-72fe2f56b6d4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:27.127037 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-ed932821-c826-45f8-b9ef-72fe2f56b6d4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 250e2ce6-70ad-4082-8073-6a9cea0ca1e4] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:27.133085 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-ed932821-c826-45f8-b9ef-72fe2f56b6d4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:27.133535 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-ed932821-c826-45f8-b9ef-72fe2f56b6d4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:27.134282 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-ed932821-c826-45f8-b9ef-72fe2f56b6d4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:27.134767 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-ed932821-c826-45f8-b9ef-72fe2f56b6d4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:27.265414 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-ed932821-c826-45f8-b9ef-72fe2f56b6d4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:27.273320 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-ed932821-c826-45f8-b9ef-72fe2f56b6d4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4" status: 200 len: 1368 microversion: 2.1 time: 0.151265 Jun 23 11:45:27.273883 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 130/237] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:27 2022] GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:45:27.278313 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-f389ee33-e1f6-4e9d-89fa-e4c01347a7c0 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:27.279070 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-f389ee33-e1f6-4e9d-89fa-e4c01347a7c0 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 0953fa06-0916-418f-b527-06d088cc6066] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:27.285359 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-f389ee33-e1f6-4e9d-89fa-e4c01347a7c0 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:27.286163 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-f389ee33-e1f6-4e9d-89fa-e4c01347a7c0 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:27.286565 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-f389ee33-e1f6-4e9d-89fa-e4c01347a7c0 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:27.287000 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-f389ee33-e1f6-4e9d-89fa-e4c01347a7c0 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:27.421113 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-f389ee33-e1f6-4e9d-89fa-e4c01347a7c0 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:27.429397 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-f389ee33-e1f6-4e9d-89fa-e4c01347a7c0 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066" status: 200 len: 1522 microversion: 2.1 time: 0.154532 Jun 23 11:45:27.430004 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 131/238] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:27 2022] GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:45:27.733145 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-c270ba81-c3ef-48b5-a0bd-292cb2ee500a tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:27.733748 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-c270ba81-c3ef-48b5-a0bd-292cb2ee500a tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:27.740116 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-c270ba81-c3ef-48b5-a0bd-292cb2ee500a tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:27.740547 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-c270ba81-c3ef-48b5-a0bd-292cb2ee500a tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:27.741355 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-c270ba81-c3ef-48b5-a0bd-292cb2ee500a tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:27.741736 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-c270ba81-c3ef-48b5-a0bd-292cb2ee500a tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:27.872734 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-c270ba81-c3ef-48b5-a0bd-292cb2ee500a tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:27.881144 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-c270ba81-c3ef-48b5-a0bd-292cb2ee500a tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 200 len: 1364 microversion: 2.1 time: 0.151741 Jun 23 11:45:27.881637 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 132/239] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:27 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:45:28.290167 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-f3466a07-8bf7-4d54-b083-51b43aac36d5 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:28.290777 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-f3466a07-8bf7-4d54-b083-51b43aac36d5 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 250e2ce6-70ad-4082-8073-6a9cea0ca1e4] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:28.296696 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-f3466a07-8bf7-4d54-b083-51b43aac36d5 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:28.297142 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-f3466a07-8bf7-4d54-b083-51b43aac36d5 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:28.297896 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-f3466a07-8bf7-4d54-b083-51b43aac36d5 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:28.298435 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-f3466a07-8bf7-4d54-b083-51b43aac36d5 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:28.303266 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_cell1:SELECT=100 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:45:28.431039 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-f3466a07-8bf7-4d54-b083-51b43aac36d5 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:28.438722 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-f3466a07-8bf7-4d54-b083-51b43aac36d5 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4" status: 200 len: 1368 microversion: 2.1 time: 0.152385 Jun 23 11:45:28.439273 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 133/240] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:28 2022] GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:45:28.449939 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-00fbc88a-26ed-45ea-b9d3-81b2800a37d4 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:28.450592 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-00fbc88a-26ed-45ea-b9d3-81b2800a37d4 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 0953fa06-0916-418f-b527-06d088cc6066] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:28.456696 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-00fbc88a-26ed-45ea-b9d3-81b2800a37d4 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:28.457438 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-00fbc88a-26ed-45ea-b9d3-81b2800a37d4 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:28.458138 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-00fbc88a-26ed-45ea-b9d3-81b2800a37d4 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:28.458387 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-00fbc88a-26ed-45ea-b9d3-81b2800a37d4 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:28.603602 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-00fbc88a-26ed-45ea-b9d3-81b2800a37d4 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:28.603602 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-00fbc88a-26ed-45ea-b9d3-81b2800a37d4 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066" status: 200 len: 1522 microversion: 2.1 time: 0.155087 Jun 23 11:45:28.603602 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 134/241] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:28 2022] GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:45:28.898099 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-23d75c67-100e-4979-985d-0b979914583f tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:28.898731 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-23d75c67-100e-4979-985d-0b979914583f tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:28.904657 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-23d75c67-100e-4979-985d-0b979914583f tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:28.905095 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-23d75c67-100e-4979-985d-0b979914583f tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:28.906017 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-23d75c67-100e-4979-985d-0b979914583f tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:28.906451 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-23d75c67-100e-4979-985d-0b979914583f tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:29.037644 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-23d75c67-100e-4979-985d-0b979914583f tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:29.048432 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-23d75c67-100e-4979-985d-0b979914583f tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 200 len: 1364 microversion: 2.1 time: 0.155169 Jun 23 11:45:29.049209 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 135/242] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:28 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:45:29.457902 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-9ad71409-b160-4f30-a74a-4fd4bb85ba80 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:29.458751 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-9ad71409-b160-4f30-a74a-4fd4bb85ba80 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 250e2ce6-70ad-4082-8073-6a9cea0ca1e4] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:29.461140 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_api:SELECT=100 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:45:29.466166 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-9ad71409-b160-4f30-a74a-4fd4bb85ba80 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:29.466822 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-9ad71409-b160-4f30-a74a-4fd4bb85ba80 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:29.468123 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-9ad71409-b160-4f30-a74a-4fd4bb85ba80 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:29.468745 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-9ad71409-b160-4f30-a74a-4fd4bb85ba80 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:29.620760 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-9ad71409-b160-4f30-a74a-4fd4bb85ba80 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:29.630488 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-9ad71409-b160-4f30-a74a-4fd4bb85ba80 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4" status: 200 len: 1368 microversion: 2.1 time: 0.177970 Jun 23 11:45:29.642835 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 136/243] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:29 2022] GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4 => generated 1368 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:45:29.658902 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-49894970-7b4d-49d2-9316-9ec0256067d6 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:29.661554 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-49894970-7b4d-49d2-9316-9ec0256067d6 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 0953fa06-0916-418f-b527-06d088cc6066] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:29.670950 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-49894970-7b4d-49d2-9316-9ec0256067d6 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:29.671630 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-49894970-7b4d-49d2-9316-9ec0256067d6 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:29.678483 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-49894970-7b4d-49d2-9316-9ec0256067d6 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:29.679317 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-49894970-7b4d-49d2-9316-9ec0256067d6 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:29.833807 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-49894970-7b4d-49d2-9316-9ec0256067d6 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:29.846129 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-49894970-7b4d-49d2-9316-9ec0256067d6 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066" status: 200 len: 1522 microversion: 2.1 time: 0.194953 Jun 23 11:45:29.847813 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 137/244] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:29 2022] GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066 => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:45:30.065148 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-bfbdeb52-121c-4ac0-9588-7f5a9dfa4871 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:30.065687 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-bfbdeb52-121c-4ac0-9588-7f5a9dfa4871 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:30.071876 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-bfbdeb52-121c-4ac0-9588-7f5a9dfa4871 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:30.072325 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-bfbdeb52-121c-4ac0-9588-7f5a9dfa4871 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:30.073086 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-bfbdeb52-121c-4ac0-9588-7f5a9dfa4871 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:30.073523 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-bfbdeb52-121c-4ac0-9588-7f5a9dfa4871 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:30.206661 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-bfbdeb52-121c-4ac0-9588-7f5a9dfa4871 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:30.214732 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-bfbdeb52-121c-4ac0-9588-7f5a9dfa4871 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 200 len: 1364 microversion: 2.1 time: 0.153444 Jun 23 11:45:30.215318 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 138/245] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:30 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:45:30.648037 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-fd47c004-3202-4b6a-9e55-933163336d40 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:30.649388 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-fd47c004-3202-4b6a-9e55-933163336d40 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 250e2ce6-70ad-4082-8073-6a9cea0ca1e4] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:30.656205 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-fd47c004-3202-4b6a-9e55-933163336d40 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:30.656821 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-fd47c004-3202-4b6a-9e55-933163336d40 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:30.657730 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-fd47c004-3202-4b6a-9e55-933163336d40 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:30.658327 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-fd47c004-3202-4b6a-9e55-933163336d40 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:30.793037 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-fd47c004-3202-4b6a-9e55-933163336d40 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:30.800572 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-fd47c004-3202-4b6a-9e55-933163336d40 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4" status: 200 len: 1368 microversion: 2.1 time: 0.156986 Jun 23 11:45:30.801699 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 139/246] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:30 2022] GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:45:30.863847 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-6e9ec795-bde0-484c-90ee-d6d642936f5d tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:30.864410 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-6e9ec795-bde0-484c-90ee-d6d642936f5d tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 0953fa06-0916-418f-b527-06d088cc6066] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:30.870352 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-6e9ec795-bde0-484c-90ee-d6d642936f5d tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:30.870831 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-6e9ec795-bde0-484c-90ee-d6d642936f5d tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:30.871629 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-6e9ec795-bde0-484c-90ee-d6d642936f5d tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:30.872067 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-6e9ec795-bde0-484c-90ee-d6d642936f5d tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:31.024861 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_api:SELECT=29 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:45:31.030799 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-6e9ec795-bde0-484c-90ee-d6d642936f5d tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:31.039450 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-6e9ec795-bde0-484c-90ee-d6d642936f5d tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066" status: 200 len: 1522 microversion: 2.1 time: 0.179435 Jun 23 11:45:31.040187 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 140/247] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:30 2022] GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:45:31.068441 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:45:31.232309 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-2d1c2f16-bda4-41c3-8cf0-b77dfb6a375e tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:31.232916 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-2d1c2f16-bda4-41c3-8cf0-b77dfb6a375e tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:31.239483 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-2d1c2f16-bda4-41c3-8cf0-b77dfb6a375e tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:31.239963 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-2d1c2f16-bda4-41c3-8cf0-b77dfb6a375e tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:31.240726 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-2d1c2f16-bda4-41c3-8cf0-b77dfb6a375e tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:31.241160 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-2d1c2f16-bda4-41c3-8cf0-b77dfb6a375e tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:31.347215 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-aa237501-e1a1-4f24-8f38-30a6a32134eb tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] 10.222.0.13 "POST /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 10.332592 Jun 23 11:45:31.351194 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 108/248] 10.222.0.13 () {60 vars in 1322 bytes} [Thu Jun 23 11:45:21 2022] POST /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d/os-volume_attachments => generated 194 bytes in 10337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:45:31.462188 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-2d1c2f16-bda4-41c3-8cf0-b77dfb6a375e tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:31.476808 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-2d1c2f16-bda4-41c3-8cf0-b77dfb6a375e tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 200 len: 1364 microversion: 2.1 time: 0.248272 Jun 23 11:45:31.477768 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 141/249] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:31 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 1364 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:45:31.819317 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-cc745b47-9f55-424d-82a5-f8b946546507 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:31.820020 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-cc745b47-9f55-424d-82a5-f8b946546507 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 250e2ce6-70ad-4082-8073-6a9cea0ca1e4] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:31.826790 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-cc745b47-9f55-424d-82a5-f8b946546507 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:31.827236 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-cc745b47-9f55-424d-82a5-f8b946546507 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:31.827991 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-cc745b47-9f55-424d-82a5-f8b946546507 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:31.828421 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-cc745b47-9f55-424d-82a5-f8b946546507 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:31.969602 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-cc745b47-9f55-424d-82a5-f8b946546507 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:31.977452 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-cc745b47-9f55-424d-82a5-f8b946546507 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4" status: 200 len: 1368 microversion: 2.1 time: 0.163883 Jun 23 11:45:31.978016 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 109/250] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:31 2022] GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4 => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:45:32.056805 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-1375c271-6bc4-4b4b-8f3c-005719cbdd19 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:32.057449 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-1375c271-6bc4-4b4b-8f3c-005719cbdd19 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 0953fa06-0916-418f-b527-06d088cc6066] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:32.063775 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1375c271-6bc4-4b4b-8f3c-005719cbdd19 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:32.064219 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1375c271-6bc4-4b4b-8f3c-005719cbdd19 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:32.065120 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1375c271-6bc4-4b4b-8f3c-005719cbdd19 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:32.065550 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1375c271-6bc4-4b4b-8f3c-005719cbdd19 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:32.258021 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-1375c271-6bc4-4b4b-8f3c-005719cbdd19 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:32.265610 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-1375c271-6bc4-4b4b-8f3c-005719cbdd19 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066" status: 200 len: 1522 microversion: 2.1 time: 0.212859 Jun 23 11:45:32.269028 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 142/251] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:32 2022] GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066 => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:45:32.493917 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-18c32286-bce9-4357-aac5-9ae6d2d763e9 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:32.494328 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-18c32286-bce9-4357-aac5-9ae6d2d763e9 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:32.500702 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-18c32286-bce9-4357-aac5-9ae6d2d763e9 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:32.501331 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-18c32286-bce9-4357-aac5-9ae6d2d763e9 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:32.502091 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-18c32286-bce9-4357-aac5-9ae6d2d763e9 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:32.502693 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-18c32286-bce9-4357-aac5-9ae6d2d763e9 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:32.630616 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-18c32286-bce9-4357-aac5-9ae6d2d763e9 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:32.637843 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-18c32286-bce9-4357-aac5-9ae6d2d763e9 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 200 len: 1364 microversion: 2.1 time: 0.148391 Jun 23 11:45:32.638443 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 110/252] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:32 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:45:32.995387 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-a42cea8a-b439-4d0f-946d-251cd2913c66 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:33.000730 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-a42cea8a-b439-4d0f-946d-251cd2913c66 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 250e2ce6-70ad-4082-8073-6a9cea0ca1e4] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:33.003441 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a42cea8a-b439-4d0f-946d-251cd2913c66 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:33.004436 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a42cea8a-b439-4d0f-946d-251cd2913c66 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:33.004975 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a42cea8a-b439-4d0f-946d-251cd2913c66 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:33.005522 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a42cea8a-b439-4d0f-946d-251cd2913c66 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:33.083431 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [req-52247c90-b75b-4afd-af4c-900c4251a7bc req-2d80ae1a-b23b-4327-a837-b8e5cceb3fb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46d9d467-7a71-4e30-af82-629121319200", "name": "network-vif-plugged", "status": "completed", "tag": "0a894540-735d-4ac5-8343-16862b680cd3"}]} {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:45:33.098655 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [req-52247c90-b75b-4afd-af4c-900c4251a7bc req-2d80ae1a-b23b-4327-a837-b8e5cceb3fb1 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:33.099250 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [req-52247c90-b75b-4afd-af4c-900c4251a7bc req-2d80ae1a-b23b-4327-a837-b8e5cceb3fb1 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:33.113230 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.compute.server_external_events [req-52247c90-b75b-4afd-af4c-900c4251a7bc req-2d80ae1a-b23b-4327-a837-b8e5cceb3fb1 service nova] Creating event network-vif-plugged:0a894540-735d-4ac5-8343-16862b680cd3 for instance 46d9d467-7a71-4e30-af82-629121319200 on hv-cinder-82099 Jun 23 11:45:33.118653 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [req-52247c90-b75b-4afd-af4c-900c4251a7bc req-2d80ae1a-b23b-4327-a837-b8e5cceb3fb1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039955 Jun 23 11:45:33.119352 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 111/253] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:45:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:45:33.284507 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-ab2f6d91-2c53-4c55-86f1-6cb5e54dbbbb tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:33.285500 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-ab2f6d91-2c53-4c55-86f1-6cb5e54dbbbb tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 0953fa06-0916-418f-b527-06d088cc6066] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:33.291958 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ab2f6d91-2c53-4c55-86f1-6cb5e54dbbbb tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:33.292444 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ab2f6d91-2c53-4c55-86f1-6cb5e54dbbbb tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:33.293428 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ab2f6d91-2c53-4c55-86f1-6cb5e54dbbbb tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:33.294013 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ab2f6d91-2c53-4c55-86f1-6cb5e54dbbbb tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:33.466038 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-a42cea8a-b439-4d0f-946d-251cd2913c66 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:33.478839 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-a42cea8a-b439-4d0f-946d-251cd2913c66 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4" status: 200 len: 1558 microversion: 2.1 time: 0.487522 Jun 23 11:45:33.479877 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 143/254] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:32 2022] GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4 => generated 1558 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:45:33.514738 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-ab2f6d91-2c53-4c55-86f1-6cb5e54dbbbb tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:33.519915 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-7a31fe61-71b7-4ac6-b21d-e7fb140ad426 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:33.519915 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-7a31fe61-71b7-4ac6-b21d-e7fb140ad426 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 250e2ce6-70ad-4082-8073-6a9cea0ca1e4] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:33.525351 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-ab2f6d91-2c53-4c55-86f1-6cb5e54dbbbb tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066" status: 200 len: 1522 microversion: 2.1 time: 0.244963 Jun 23 11:45:33.536022 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-7a31fe61-71b7-4ac6-b21d-e7fb140ad426 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:33.536022 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-7a31fe61-71b7-4ac6-b21d-e7fb140ad426 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:33.536022 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-7a31fe61-71b7-4ac6-b21d-e7fb140ad426 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:33.536022 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-7a31fe61-71b7-4ac6-b21d-e7fb140ad426 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:33.537820 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 112/255] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:33 2022] GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066 => generated 1522 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:45:33.655618 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-187c75ad-0b62-4453-b568-9fdb3b26609a tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:33.656426 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-187c75ad-0b62-4453-b568-9fdb3b26609a tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:33.683302 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-187c75ad-0b62-4453-b568-9fdb3b26609a tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:33.688888 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-187c75ad-0b62-4453-b568-9fdb3b26609a tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:33.688888 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-187c75ad-0b62-4453-b568-9fdb3b26609a tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:33.688888 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-187c75ad-0b62-4453-b568-9fdb3b26609a tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:33.714931 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-7a31fe61-71b7-4ac6-b21d-e7fb140ad426 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.203037 Jun 23 11:45:33.716505 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 144/256] 10.222.0.13 () {58 vars in 1274 bytes} [Thu Jun 23 11:45:33 2022] GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4/os-interface => generated 284 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:45:33.896310 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-187c75ad-0b62-4453-b568-9fdb3b26609a tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:33.904606 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-187c75ad-0b62-4453-b568-9fdb3b26609a tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 200 len: 1364 microversion: 2.1 time: 0.253733 Jun 23 11:45:33.905175 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 113/257] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:33 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 1364 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:45:34.542893 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-36fd928c-c204-4f75-85e7-4c770b620ae1 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:34.543502 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-36fd928c-c204-4f75-85e7-4c770b620ae1 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 0953fa06-0916-418f-b527-06d088cc6066] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:34.550386 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-36fd928c-c204-4f75-85e7-4c770b620ae1 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:34.551800 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-36fd928c-c204-4f75-85e7-4c770b620ae1 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:34.552782 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-36fd928c-c204-4f75-85e7-4c770b620ae1 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:34.553330 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-36fd928c-c204-4f75-85e7-4c770b620ae1 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:34.690609 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-36fd928c-c204-4f75-85e7-4c770b620ae1 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:34.698318 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-36fd928c-c204-4f75-85e7-4c770b620ae1 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066" status: 200 len: 1522 microversion: 2.1 time: 0.159591 Jun 23 11:45:34.698910 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 145/258] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:34 2022] GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:45:34.922481 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-16602d9b-df98-4365-bc8f-5a7b00e6088f tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:34.923882 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-16602d9b-df98-4365-bc8f-5a7b00e6088f tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:34.930806 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-16602d9b-df98-4365-bc8f-5a7b00e6088f tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:34.931260 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-16602d9b-df98-4365-bc8f-5a7b00e6088f tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:34.932033 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-16602d9b-df98-4365-bc8f-5a7b00e6088f tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:34.932475 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-16602d9b-df98-4365-bc8f-5a7b00e6088f tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:35.114856 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-16602d9b-df98-4365-bc8f-5a7b00e6088f tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:35.123325 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-16602d9b-df98-4365-bc8f-5a7b00e6088f tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 200 len: 1364 microversion: 2.1 time: 0.204597 Jun 23 11:45:35.123897 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 114/259] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:34 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 1364 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:45:35.217624 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [req-ab261b25-8c03-4a5f-9a12-169a8c15897f req-88920ca5-a78a-4b32-bbc8-a465b9ffb05c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "250e2ce6-70ad-4082-8073-6a9cea0ca1e4", "tag": "acf9b9ee-0912-476a-bbae-a8fa23161cdb"}]} {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:45:35.226897 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-ab261b25-8c03-4a5f-9a12-169a8c15897f req-88920ca5-a78a-4b32-bbc8-a465b9ffb05c service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:35.227527 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-ab261b25-8c03-4a5f-9a12-169a8c15897f req-88920ca5-a78a-4b32-bbc8-a465b9ffb05c service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:35.241333 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.compute.server_external_events [req-ab261b25-8c03-4a5f-9a12-169a8c15897f req-88920ca5-a78a-4b32-bbc8-a465b9ffb05c service nova] Creating event network-changed:acf9b9ee-0912-476a-bbae-a8fa23161cdb for instance 250e2ce6-70ad-4082-8073-6a9cea0ca1e4 on hv-cinder-82099 Jun 23 11:45:35.246554 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [req-ab261b25-8c03-4a5f-9a12-169a8c15897f req-88920ca5-a78a-4b32-bbc8-a465b9ffb05c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032466 Jun 23 11:45:35.247332 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 146/260] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:45:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:45:35.717374 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-747a2397-0a4b-4ded-8f26-69797eb0fc32 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:35.717989 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-747a2397-0a4b-4ded-8f26-69797eb0fc32 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 0953fa06-0916-418f-b527-06d088cc6066] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:35.731112 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-747a2397-0a4b-4ded-8f26-69797eb0fc32 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:35.731568 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-747a2397-0a4b-4ded-8f26-69797eb0fc32 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:35.732354 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-747a2397-0a4b-4ded-8f26-69797eb0fc32 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:35.732787 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-747a2397-0a4b-4ded-8f26-69797eb0fc32 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:35.900452 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-747a2397-0a4b-4ded-8f26-69797eb0fc32 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:35.908202 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-747a2397-0a4b-4ded-8f26-69797eb0fc32 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066" status: 200 len: 1522 microversion: 2.1 time: 0.194272 Jun 23 11:45:35.908614 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 115/261] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:35 2022] GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066 => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:45:36.141332 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-3c84d1a6-324b-444c-bf7a-428702f0e960 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:36.142039 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-3c84d1a6-324b-444c-bf7a-428702f0e960 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:36.149092 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-3c84d1a6-324b-444c-bf7a-428702f0e960 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:36.149468 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-3c84d1a6-324b-444c-bf7a-428702f0e960 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:36.150238 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-3c84d1a6-324b-444c-bf7a-428702f0e960 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:36.150703 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-3c84d1a6-324b-444c-bf7a-428702f0e960 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:36.296208 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-3c84d1a6-324b-444c-bf7a-428702f0e960 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:36.305928 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-3c84d1a6-324b-444c-bf7a-428702f0e960 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 200 len: 1364 microversion: 2.1 time: 0.168771 Jun 23 11:45:36.306727 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 147/262] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:36 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:45:36.926714 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-88b942a7-eb3a-41a4-a870-c0eb7b42f6a7 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:36.927367 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-88b942a7-eb3a-41a4-a870-c0eb7b42f6a7 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 0953fa06-0916-418f-b527-06d088cc6066] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:36.934623 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-88b942a7-eb3a-41a4-a870-c0eb7b42f6a7 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:36.935079 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-88b942a7-eb3a-41a4-a870-c0eb7b42f6a7 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:36.935850 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-88b942a7-eb3a-41a4-a870-c0eb7b42f6a7 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:36.936286 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-88b942a7-eb3a-41a4-a870-c0eb7b42f6a7 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:37.070789 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-88b942a7-eb3a-41a4-a870-c0eb7b42f6a7 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:37.078711 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-88b942a7-eb3a-41a4-a870-c0eb7b42f6a7 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066" status: 200 len: 1522 microversion: 2.1 time: 0.157250 Jun 23 11:45:37.079265 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 116/263] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:36 2022] GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:45:37.327551 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-4afc2e4d-6f01-4246-9045-09220d79c923 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:37.328230 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-4afc2e4d-6f01-4246-9045-09220d79c923 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:37.336205 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-4afc2e4d-6f01-4246-9045-09220d79c923 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:37.336642 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-4afc2e4d-6f01-4246-9045-09220d79c923 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:37.337417 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-4afc2e4d-6f01-4246-9045-09220d79c923 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:37.337843 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-4afc2e4d-6f01-4246-9045-09220d79c923 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:37.473788 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-4afc2e4d-6f01-4246-9045-09220d79c923 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:37.481430 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-4afc2e4d-6f01-4246-9045-09220d79c923 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 200 len: 1364 microversion: 2.1 time: 0.157679 Jun 23 11:45:37.492107 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 148/264] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:37 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:45:38.095320 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-af4faa6e-b8ad-4dc8-8132-b8cd8a9f4ba3 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:38.095927 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-af4faa6e-b8ad-4dc8-8132-b8cd8a9f4ba3 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 0953fa06-0916-418f-b527-06d088cc6066] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:38.102220 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-af4faa6e-b8ad-4dc8-8132-b8cd8a9f4ba3 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:38.102689 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-af4faa6e-b8ad-4dc8-8132-b8cd8a9f4ba3 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:38.103563 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-af4faa6e-b8ad-4dc8-8132-b8cd8a9f4ba3 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:38.104254 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-af4faa6e-b8ad-4dc8-8132-b8cd8a9f4ba3 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:38.292604 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-af4faa6e-b8ad-4dc8-8132-b8cd8a9f4ba3 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:38.300389 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-af4faa6e-b8ad-4dc8-8132-b8cd8a9f4ba3 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066" status: 200 len: 1522 microversion: 2.1 time: 0.208761 Jun 23 11:45:38.301558 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 117/265] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:38 2022] GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066 => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:45:38.500685 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-8115b100-76fa-4e2a-b0f6-3b6eaafe0929 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:38.501374 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-8115b100-76fa-4e2a-b0f6-3b6eaafe0929 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:38.507490 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-8115b100-76fa-4e2a-b0f6-3b6eaafe0929 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:38.507936 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-8115b100-76fa-4e2a-b0f6-3b6eaafe0929 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:38.508687 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-8115b100-76fa-4e2a-b0f6-3b6eaafe0929 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:38.509119 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-8115b100-76fa-4e2a-b0f6-3b6eaafe0929 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:38.643404 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-8115b100-76fa-4e2a-b0f6-3b6eaafe0929 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:38.651348 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-8115b100-76fa-4e2a-b0f6-3b6eaafe0929 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 200 len: 1364 microversion: 2.1 time: 0.155258 Jun 23 11:45:38.651906 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 149/266] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:38 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:45:39.317000 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-19ba9de7-af55-4c73-9d3b-e7b477b6f864 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:39.318142 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-19ba9de7-af55-4c73-9d3b-e7b477b6f864 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 0953fa06-0916-418f-b527-06d088cc6066] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:39.324687 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-19ba9de7-af55-4c73-9d3b-e7b477b6f864 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:39.325133 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-19ba9de7-af55-4c73-9d3b-e7b477b6f864 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:39.325882 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-19ba9de7-af55-4c73-9d3b-e7b477b6f864 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:39.326315 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-19ba9de7-af55-4c73-9d3b-e7b477b6f864 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:39.458014 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-19ba9de7-af55-4c73-9d3b-e7b477b6f864 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:39.466226 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-19ba9de7-af55-4c73-9d3b-e7b477b6f864 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066" status: 200 len: 1522 microversion: 2.1 time: 0.153038 Jun 23 11:45:39.466821 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 118/267] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:39 2022] GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:45:39.668546 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-99b1b831-2eb7-42f1-ac9d-14244ad2f3ca tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:39.669273 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-99b1b831-2eb7-42f1-ac9d-14244ad2f3ca tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:39.675754 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-99b1b831-2eb7-42f1-ac9d-14244ad2f3ca tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:39.676197 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-99b1b831-2eb7-42f1-ac9d-14244ad2f3ca tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:39.677497 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-99b1b831-2eb7-42f1-ac9d-14244ad2f3ca tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:39.678232 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-99b1b831-2eb7-42f1-ac9d-14244ad2f3ca tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:39.813529 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-99b1b831-2eb7-42f1-ac9d-14244ad2f3ca tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:39.817369 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_cell1:SELECT=100 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:45:39.823114 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-99b1b831-2eb7-42f1-ac9d-14244ad2f3ca tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 200 len: 1364 microversion: 2.1 time: 0.158276 Jun 23 11:45:39.823655 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 150/268] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:39 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:45:40.483979 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-135bef73-63d6-4756-9c0f-b0160e4ec3b3 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:40.484626 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-135bef73-63d6-4756-9c0f-b0160e4ec3b3 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 0953fa06-0916-418f-b527-06d088cc6066] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:40.491557 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-135bef73-63d6-4756-9c0f-b0160e4ec3b3 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:40.492114 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-135bef73-63d6-4756-9c0f-b0160e4ec3b3 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:40.492852 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-135bef73-63d6-4756-9c0f-b0160e4ec3b3 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:40.493454 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-135bef73-63d6-4756-9c0f-b0160e4ec3b3 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:40.645135 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-135bef73-63d6-4756-9c0f-b0160e4ec3b3 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:40.652813 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-135bef73-63d6-4756-9c0f-b0160e4ec3b3 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066" status: 200 len: 1522 microversion: 2.1 time: 0.172915 Jun 23 11:45:40.653389 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 119/269] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:40 2022] GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:45:40.848433 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-bb139edb-143c-484b-be7f-820eae3bb009 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:40.849211 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-bb139edb-143c-484b-be7f-820eae3bb009 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:40.855709 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-bb139edb-143c-484b-be7f-820eae3bb009 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:40.856154 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-bb139edb-143c-484b-be7f-820eae3bb009 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:40.856911 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-bb139edb-143c-484b-be7f-820eae3bb009 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:40.857340 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-bb139edb-143c-484b-be7f-820eae3bb009 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:41.067973 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-bb139edb-143c-484b-be7f-820eae3bb009 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:41.069076 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-bb139edb-143c-484b-be7f-820eae3bb009 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 200 len: 1551 microversion: 2.1 time: 0.224420 Jun 23 11:45:41.069650 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 151/270] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:40 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 1551 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:45:41.093409 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-65b13ad4-253a-4fe4-93b5-c6f44016b1dd tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:41.102084 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-65b13ad4-253a-4fe4-93b5-c6f44016b1dd tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:41.108348 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-65b13ad4-253a-4fe4-93b5-c6f44016b1dd tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:41.108804 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-65b13ad4-253a-4fe4-93b5-c6f44016b1dd tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:41.109594 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-65b13ad4-253a-4fe4-93b5-c6f44016b1dd tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:41.119384 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-65b13ad4-253a-4fe4-93b5-c6f44016b1dd tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:41.207810 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-65b13ad4-253a-4fe4-93b5-c6f44016b1dd tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.125994 Jun 23 11:45:41.208665 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 120/271] 10.222.0.13 () {58 vars in 1274 bytes} [Thu Jun 23 11:45:41 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200/os-interface => generated 285 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:45:41.669506 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-5ec6846e-c82a-4f2f-a262-3ac99b64cb48 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:41.670355 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-5ec6846e-c82a-4f2f-a262-3ac99b64cb48 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 0953fa06-0916-418f-b527-06d088cc6066] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:41.677280 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-5ec6846e-c82a-4f2f-a262-3ac99b64cb48 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:41.678104 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-5ec6846e-c82a-4f2f-a262-3ac99b64cb48 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:41.679063 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-5ec6846e-c82a-4f2f-a262-3ac99b64cb48 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:41.680856 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-5ec6846e-c82a-4f2f-a262-3ac99b64cb48 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:42.016091 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-5ec6846e-c82a-4f2f-a262-3ac99b64cb48 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:42.027021 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-5ec6846e-c82a-4f2f-a262-3ac99b64cb48 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066" status: 200 len: 1522 microversion: 2.1 time: 0.361216 Jun 23 11:45:42.027981 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 152/272] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:41 2022] GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066 => generated 1522 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:45:42.964246 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [req-d7f7ae01-2a9d-490b-aa1e-2c6a6f7bb6e0 req-1cf21ce2-ac2c-4ec0-a237-bea5b0d7ff3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46d9d467-7a71-4e30-af82-629121319200", "tag": "0a894540-735d-4ac5-8343-16862b680cd3"}]} {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:45:42.975825 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [req-d7f7ae01-2a9d-490b-aa1e-2c6a6f7bb6e0 req-1cf21ce2-ac2c-4ec0-a237-bea5b0d7ff3c service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:42.976664 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [req-d7f7ae01-2a9d-490b-aa1e-2c6a6f7bb6e0 req-1cf21ce2-ac2c-4ec0-a237-bea5b0d7ff3c service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:42.998804 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.compute.server_external_events [req-d7f7ae01-2a9d-490b-aa1e-2c6a6f7bb6e0 req-1cf21ce2-ac2c-4ec0-a237-bea5b0d7ff3c service nova] Creating event network-changed:0a894540-735d-4ac5-8343-16862b680cd3 for instance 46d9d467-7a71-4e30-af82-629121319200 on hv-cinder-82099 Jun 23 11:45:43.004009 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [req-d7f7ae01-2a9d-490b-aa1e-2c6a6f7bb6e0 req-1cf21ce2-ac2c-4ec0-a237-bea5b0d7ff3c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045632 Jun 23 11:45:43.004645 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 121/273] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:45:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:45:43.050689 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-eefa8329-f6d0-43c7-a9b3-9fe332e15010 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:43.051522 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-eefa8329-f6d0-43c7-a9b3-9fe332e15010 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 0953fa06-0916-418f-b527-06d088cc6066] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:43.065969 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-eefa8329-f6d0-43c7-a9b3-9fe332e15010 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:43.068581 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-eefa8329-f6d0-43c7-a9b3-9fe332e15010 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:43.069967 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-eefa8329-f6d0-43c7-a9b3-9fe332e15010 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:43.070762 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-eefa8329-f6d0-43c7-a9b3-9fe332e15010 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:43.376048 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-72642d48-c127-4679-98b0-b3f9df260bb8 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:43.376701 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-72642d48-c127-4679-98b0-b3f9df260bb8 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] [instance: 16a06134-ea93-492f-a705-29cc31876c5d] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:43.389505 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-72642d48-c127-4679-98b0-b3f9df260bb8 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:43.390038 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-72642d48-c127-4679-98b0-b3f9df260bb8 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:43.390922 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-72642d48-c127-4679-98b0-b3f9df260bb8 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:43.391448 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-72642d48-c127-4679-98b0-b3f9df260bb8 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:43.414646 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-eefa8329-f6d0-43c7-a9b3-9fe332e15010 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:43.423144 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-eefa8329-f6d0-43c7-a9b3-9fe332e15010 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066" status: 200 len: 1522 microversion: 2.1 time: 0.383018 Jun 23 11:45:43.423775 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 153/274] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:43 2022] GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066 => generated 1522 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:45:43.431572 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-72642d48-c127-4679-98b0-b3f9df260bb8 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] [instance: 16a06134-ea93-492f-a705-29cc31876c5d] Going to try to terminate instance {{(pid=124669) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 11:45:43.788547 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-72642d48-c127-4679-98b0-b3f9df260bb8 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] 10.222.0.13 "DELETE /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d" status: 204 len: 0 microversion: 2.1 time: 0.416644 Jun 23 11:45:43.790120 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 122/275] 10.222.0.13 () {58 vars in 1238 bytes} [Thu Jun 23 11:45:43 2022] DELETE /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d => generated 0 bytes in 420 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 23 11:45:43.803206 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-c6f23a09-5955-4e7c-9951-35074045cbb6 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:43.809081 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-c6f23a09-5955-4e7c-9951-35074045cbb6 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] [instance: 16a06134-ea93-492f-a705-29cc31876c5d] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:43.832820 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-c6f23a09-5955-4e7c-9951-35074045cbb6 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:43.834650 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-c6f23a09-5955-4e7c-9951-35074045cbb6 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:43.845663 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-c6f23a09-5955-4e7c-9951-35074045cbb6 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:43.847093 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-c6f23a09-5955-4e7c-9951-35074045cbb6 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:44.037803 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-c6f23a09-5955-4e7c-9951-35074045cbb6 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae72d6c494ba4f16989adfe090803d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515e65a705ee46cc8f8e03efbe58f177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:44.047473 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-c6f23a09-5955-4e7c-9951-35074045cbb6 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] 10.222.0.13 "GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d" status: 200 len: 1553 microversion: 2.1 time: 0.252004 Jun 23 11:45:44.051107 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 154/276] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:43 2022] GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d => generated 1553 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:45:44.441960 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-0f2cddb9-9d44-418f-8ede-d83a6e78320c tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:44.443191 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-0f2cddb9-9d44-418f-8ede-d83a6e78320c tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 0953fa06-0916-418f-b527-06d088cc6066] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:44.450143 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-0f2cddb9-9d44-418f-8ede-d83a6e78320c tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:44.452422 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-0f2cddb9-9d44-418f-8ede-d83a6e78320c tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:44.452422 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-0f2cddb9-9d44-418f-8ede-d83a6e78320c tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:44.452422 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-0f2cddb9-9d44-418f-8ede-d83a6e78320c tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:44.633235 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-0f2cddb9-9d44-418f-8ede-d83a6e78320c tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:44.640805 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-0f2cddb9-9d44-418f-8ede-d83a6e78320c tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066" status: 200 len: 1522 microversion: 2.1 time: 0.203247 Jun 23 11:45:44.641374 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 123/277] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:44 2022] GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066 => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:45:45.108002 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-e68534e3-5a74-44d3-9990-487bec66d2ab tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:45.108002 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-e68534e3-5a74-44d3-9990-487bec66d2ab tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] [instance: 16a06134-ea93-492f-a705-29cc31876c5d] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:45.108002 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-e68534e3-5a74-44d3-9990-487bec66d2ab tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:45.108002 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-e68534e3-5a74-44d3-9990-487bec66d2ab tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:45.110242 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-e68534e3-5a74-44d3-9990-487bec66d2ab tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:45.110242 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-e68534e3-5a74-44d3-9990-487bec66d2ab tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:45.236527 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-e68534e3-5a74-44d3-9990-487bec66d2ab tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae72d6c494ba4f16989adfe090803d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515e65a705ee46cc8f8e03efbe58f177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:45.245833 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-e68534e3-5a74-44d3-9990-487bec66d2ab tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] 10.222.0.13 "GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d" status: 200 len: 1553 microversion: 2.1 time: 0.180478 Jun 23 11:45:45.246474 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 155/278] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:45 2022] GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d => generated 1553 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:45:45.659071 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-445e6696-ca12-42c4-8065-681a2347b17f tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:45.659924 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-445e6696-ca12-42c4-8065-681a2347b17f tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 0953fa06-0916-418f-b527-06d088cc6066] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:45.667113 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-445e6696-ca12-42c4-8065-681a2347b17f tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:45.671002 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-445e6696-ca12-42c4-8065-681a2347b17f tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:45.671002 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-445e6696-ca12-42c4-8065-681a2347b17f tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:45.671002 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-445e6696-ca12-42c4-8065-681a2347b17f tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:45.816504 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-445e6696-ca12-42c4-8065-681a2347b17f tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:45.825068 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-445e6696-ca12-42c4-8065-681a2347b17f tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066" status: 200 len: 1522 microversion: 2.1 time: 0.170361 Jun 23 11:45:45.826617 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 124/279] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:45 2022] GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:45:46.263201 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-8e63559f-b4d0-4859-9fcf-beeb77a31e6f tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:46.263832 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-8e63559f-b4d0-4859-9fcf-beeb77a31e6f tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] [instance: 16a06134-ea93-492f-a705-29cc31876c5d] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:46.269810 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-8e63559f-b4d0-4859-9fcf-beeb77a31e6f tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:46.270246 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-8e63559f-b4d0-4859-9fcf-beeb77a31e6f tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:46.275176 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-8e63559f-b4d0-4859-9fcf-beeb77a31e6f tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:46.275666 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-8e63559f-b4d0-4859-9fcf-beeb77a31e6f tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:46.589594 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-8e63559f-b4d0-4859-9fcf-beeb77a31e6f tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae72d6c494ba4f16989adfe090803d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515e65a705ee46cc8f8e03efbe58f177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:46.597962 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-8e63559f-b4d0-4859-9fcf-beeb77a31e6f tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] 10.222.0.13 "GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d" status: 200 len: 1553 microversion: 2.1 time: 0.338682 Jun 23 11:45:46.599133 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 156/280] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:46 2022] GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d => generated 1553 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:45:46.845213 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-2a8d3fcb-924f-4c38-92bb-02a67ccd1263 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:46.845213 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-2a8d3fcb-924f-4c38-92bb-02a67ccd1263 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 0953fa06-0916-418f-b527-06d088cc6066] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:46.860769 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-2a8d3fcb-924f-4c38-92bb-02a67ccd1263 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:46.861786 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-2a8d3fcb-924f-4c38-92bb-02a67ccd1263 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:46.862797 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-2a8d3fcb-924f-4c38-92bb-02a67ccd1263 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:46.863499 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-2a8d3fcb-924f-4c38-92bb-02a67ccd1263 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:46.869124 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:45:47.023646 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-2a8d3fcb-924f-4c38-92bb-02a67ccd1263 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:47.068740 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-2a8d3fcb-924f-4c38-92bb-02a67ccd1263 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066" status: 200 len: 1522 microversion: 2.1 time: 0.228429 Jun 23 11:45:47.083238 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 125/281] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:46 2022] GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066 => generated 1522 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:45:47.150236 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [req-1be45720-7f11-45fb-b4fd-8ef579e909d5 req-90251840-c12d-4b85-a9a9-edfbac0b74bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16a06134-ea93-492f-a705-29cc31876c5d", "name": "network-vif-deleted", "tag": "66ff8d4e-945d-42bc-b261-4309e6e07015"}]} {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:45:47.165741 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-1be45720-7f11-45fb-b4fd-8ef579e909d5 req-90251840-c12d-4b85-a9a9-edfbac0b74bb service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:47.166199 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-1be45720-7f11-45fb-b4fd-8ef579e909d5 req-90251840-c12d-4b85-a9a9-edfbac0b74bb service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:47.183406 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.compute.server_external_events [req-1be45720-7f11-45fb-b4fd-8ef579e909d5 req-90251840-c12d-4b85-a9a9-edfbac0b74bb service nova] Creating event network-vif-deleted:66ff8d4e-945d-42bc-b261-4309e6e07015 for instance 16a06134-ea93-492f-a705-29cc31876c5d on hv-cinder-82099 Jun 23 11:45:47.190146 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [req-1be45720-7f11-45fb-b4fd-8ef579e909d5 req-90251840-c12d-4b85-a9a9-edfbac0b74bb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045978 Jun 23 11:45:47.191071 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 157/282] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:45:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:45:47.618310 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-b9b8c0db-db40-4862-a6cb-45cd78400544 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:47.619391 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-b9b8c0db-db40-4862-a6cb-45cd78400544 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] [instance: 16a06134-ea93-492f-a705-29cc31876c5d] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:47.627530 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-b9b8c0db-db40-4862-a6cb-45cd78400544 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:47.627975 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-b9b8c0db-db40-4862-a6cb-45cd78400544 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:47.629664 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-b9b8c0db-db40-4862-a6cb-45cd78400544 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:47.631311 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-b9b8c0db-db40-4862-a6cb-45cd78400544 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:47.746931 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-b9b8c0db-db40-4862-a6cb-45cd78400544 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae72d6c494ba4f16989adfe090803d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515e65a705ee46cc8f8e03efbe58f177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:47.758041 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-b9b8c0db-db40-4862-a6cb-45cd78400544 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] 10.222.0.13 "GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d" status: 200 len: 1345 microversion: 2.1 time: 0.145421 Jun 23 11:45:47.760625 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 126/283] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:47 2022] GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d => generated 1345 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:45:48.088145 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-56b5b618-4257-45cc-a0f8-51c0736d33b4 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:48.088838 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-56b5b618-4257-45cc-a0f8-51c0736d33b4 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 0953fa06-0916-418f-b527-06d088cc6066] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:48.095199 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-56b5b618-4257-45cc-a0f8-51c0736d33b4 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:48.095647 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-56b5b618-4257-45cc-a0f8-51c0736d33b4 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:48.096398 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-56b5b618-4257-45cc-a0f8-51c0736d33b4 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:48.096861 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-56b5b618-4257-45cc-a0f8-51c0736d33b4 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:48.289002 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-56b5b618-4257-45cc-a0f8-51c0736d33b4 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:48.296550 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-56b5b618-4257-45cc-a0f8-51c0736d33b4 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066" status: 200 len: 1522 microversion: 2.1 time: 0.212866 Jun 23 11:45:48.297201 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 158/284] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:48 2022] GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066 => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:45:48.776806 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-54c6649e-5368-48e4-a1da-8a052789585e tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:48.778037 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-54c6649e-5368-48e4-a1da-8a052789585e tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] [instance: 16a06134-ea93-492f-a705-29cc31876c5d] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:48.784974 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-54c6649e-5368-48e4-a1da-8a052789585e tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:48.785421 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-54c6649e-5368-48e4-a1da-8a052789585e tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:48.786561 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-54c6649e-5368-48e4-a1da-8a052789585e tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:48.787011 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-54c6649e-5368-48e4-a1da-8a052789585e tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:48.801757 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.wsgi [None req-54c6649e-5368-48e4-a1da-8a052789585e tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] HTTP exception thrown: Instance 16a06134-ea93-492f-a705-29cc31876c5d could not be found. Jun 23 11:45:48.806576 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-54c6649e-5368-48e4-a1da-8a052789585e tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Request method failure captured: Jun 23 11:45:48.806576 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: request: GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d HTTP/1.1 Jun 23 11:45:48.806576 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Accept: application/json Jun 23 11:45:48.806576 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Accept-Encoding: identity Jun 23 11:45:48.806576 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Connection: close Jun 23 11:45:48.806576 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Content-Length: 0 Jun 23 11:45:48.806576 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Content-Type: application/json Jun 23 11:45:48.806576 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Host: 10.222.0.13 Jun 23 11:45:48.806576 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Openstack-System-Scope: None Jun 23 11:45:48.806576 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: User-Agent: python-urllib3/1.26.9 Jun 23 11:45:48.806576 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Auth-Token: gAAAAABitFIUL9DXw8PXhp-LbpHMVV8sz_VzQFwIww2XXk26XmYpGOqZf1_9T8lnjkbaxC6mcynN-ttRa9MgLEDxMQxFNnak2mvltFhQV_-vnUlrLSosO6MlepRFLu1a76iJI4o2NNk-UTXRTWLsoLrsC8x8vPuFM7n_GpT1H9Z_lVdoVjsa-4o Jun 23 11:45:48.806576 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Domain-Id: None Jun 23 11:45:48.806576 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Domain-Name: None Jun 23 11:45:48.806576 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Identity-Status: Confirmed Jun 23 11:45:48.806576 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Is-Admin-Project: True Jun 23 11:45:48.806576 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Domain-Id: default Jun 23 11:45:48.806576 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Domain-Name: Default Jun 23 11:45:48.806576 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Id: 515e65a705ee46cc8f8e03efbe58f177 Jun 23 11:45:48.806576 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Name: tempest-DeleteServersTestJSON-1774813048 Jun 23 11:45:48.806576 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Role: member,reader Jun 23 11:45:48.806576 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Roles: member,reader Jun 23 11:45:48.808021 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_515e65a705ee46cc8f8e03efbe58f177"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/515e65a705ee46cc8f8e03efbe58f177"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/515e65a705ee46cc8f8e03efbe58f177"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/515e65a705ee46cc8f8e03efbe58f177"}]}] Jun 23 11:45:48.808021 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant: tempest-DeleteServersTestJSON-1774813048 Jun 23 11:45:48.808021 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant-Id: 515e65a705ee46cc8f8e03efbe58f177 Jun 23 11:45:48.808021 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant-Name: tempest-DeleteServersTestJSON-1774813048 Jun 23 11:45:48.808021 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User: tempest-DeleteServersTestJSON-1774813048-project Jun 23 11:45:48.808021 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Domain-Id: default Jun 23 11:45:48.808021 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Domain-Name: Default Jun 23 11:45:48.808021 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Id: ae72d6c494ba4f16989adfe090803d47 Jun 23 11:45:48.808021 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Name: tempest-DeleteServersTestJSON-1774813048-project Jun 23 11:45:48.808021 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: method: > Jun 23 11:45:48.808021 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: exception: Instance 16a06134-ea93-492f-a705-29cc31876c5d could not be found. Jun 23 11:45:48.808021 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: action_args: {'id': '16a06134-ea93-492f-a705-29cc31876c5d'} Jun 23 11:45:48.808771 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:45:48.808771 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:45:48.808771 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:45:48.808771 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:45:48.808771 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:45:48.808771 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:45:48.808771 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:45:48.808771 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:45:48.808771 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:45:48.808771 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:45:48.808771 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16a06134-ea93-492f-a705-29cc31876c5d could not be found. Jun 23 11:45:48.808771 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:45:48.808771 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:45:48.808771 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:45:48.808771 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:45:48.808771 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:45:48.808771 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:45:48.808771 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:45:48.808771 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:45:48.808771 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:45:48.810038 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:45:48.810038 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 11:45:48.810038 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 11:45:48.810038 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:45:48.810038 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:45:48.810038 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:45:48.810038 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:45:48.810038 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16a06134-ea93-492f-a705-29cc31876c5d could not be found. Jun 23 11:45:48.810038 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:45:48.810038 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:45:48.810038 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:45:48.810038 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:45:48.810038 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:45:48.810038 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:45:48.810038 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:45:48.810038 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:45:48.810038 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16a06134-ea93-492f-a705-29cc31876c5d could not be found. Jun 23 11:45:48.810038 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:45:48.811287 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-54c6649e-5368-48e4-a1da-8a052789585e tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Returning 404 to user: Instance 16a06134-ea93-492f-a705-29cc31876c5d could not be found. {{(pid=124669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:45:48.811287 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-54c6649e-5368-48e4-a1da-8a052789585e tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] 10.222.0.13 "GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d" status: 404 len: 111 microversion: 2.1 time: 0.035472 Jun 23 11:45:48.811287 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 127/285] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:48 2022] GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 23 11:45:48.920687 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-387a1f6f-ea15-4ff3-a072-d57567b84af4 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:48.921774 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-387a1f6f-ea15-4ff3-a072-d57567b84af4 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] [instance: 16a06134-ea93-492f-a705-29cc31876c5d] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:48.932705 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-387a1f6f-ea15-4ff3-a072-d57567b84af4 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:48.938417 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-387a1f6f-ea15-4ff3-a072-d57567b84af4 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:48.938417 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-387a1f6f-ea15-4ff3-a072-d57567b84af4 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:48.938417 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-387a1f6f-ea15-4ff3-a072-d57567b84af4 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:48.948196 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.wsgi [None req-387a1f6f-ea15-4ff3-a072-d57567b84af4 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] HTTP exception thrown: Instance 16a06134-ea93-492f-a705-29cc31876c5d could not be found. Jun 23 11:45:48.952558 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-387a1f6f-ea15-4ff3-a072-d57567b84af4 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Request method failure captured: Jun 23 11:45:48.952558 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: request: GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d/os-volume_attachments HTTP/1.1 Jun 23 11:45:48.952558 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Accept: application/json Jun 23 11:45:48.952558 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Accept-Encoding: identity Jun 23 11:45:48.952558 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Connection: close Jun 23 11:45:48.952558 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Content-Length: 0 Jun 23 11:45:48.952558 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Content-Type: application/json Jun 23 11:45:48.952558 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Host: 10.222.0.13 Jun 23 11:45:48.952558 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Openstack-System-Scope: None Jun 23 11:45:48.952558 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: User-Agent: python-urllib3/1.26.9 Jun 23 11:45:48.952558 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Auth-Token: gAAAAABitFIUL9DXw8PXhp-LbpHMVV8sz_VzQFwIww2XXk26XmYpGOqZf1_9T8lnjkbaxC6mcynN-ttRa9MgLEDxMQxFNnak2mvltFhQV_-vnUlrLSosO6MlepRFLu1a76iJI4o2NNk-UTXRTWLsoLrsC8x8vPuFM7n_GpT1H9Z_lVdoVjsa-4o Jun 23 11:45:48.952558 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Domain-Id: None Jun 23 11:45:48.952558 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Domain-Name: None Jun 23 11:45:48.952558 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Identity-Status: Confirmed Jun 23 11:45:48.952558 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Is-Admin-Project: True Jun 23 11:45:48.952558 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Domain-Id: default Jun 23 11:45:48.952558 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Domain-Name: Default Jun 23 11:45:48.952558 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Id: 515e65a705ee46cc8f8e03efbe58f177 Jun 23 11:45:48.952558 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Name: tempest-DeleteServersTestJSON-1774813048 Jun 23 11:45:48.952558 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Role: member,reader Jun 23 11:45:48.952558 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Roles: member,reader Jun 23 11:45:48.954016 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_515e65a705ee46cc8f8e03efbe58f177"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/515e65a705ee46cc8f8e03efbe58f177"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/515e65a705ee46cc8f8e03efbe58f177"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/515e65a705ee46cc8f8e03efbe58f177"}]}] Jun 23 11:45:48.954016 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Tenant: tempest-DeleteServersTestJSON-1774813048 Jun 23 11:45:48.954016 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Tenant-Id: 515e65a705ee46cc8f8e03efbe58f177 Jun 23 11:45:48.954016 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Tenant-Name: tempest-DeleteServersTestJSON-1774813048 Jun 23 11:45:48.954016 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User: tempest-DeleteServersTestJSON-1774813048-project Jun 23 11:45:48.954016 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Domain-Id: default Jun 23 11:45:48.954016 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Domain-Name: Default Jun 23 11:45:48.954016 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Id: ae72d6c494ba4f16989adfe090803d47 Jun 23 11:45:48.954016 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Name: tempest-DeleteServersTestJSON-1774813048-project Jun 23 11:45:48.954016 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: method: > Jun 23 11:45:48.954016 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: exception: Instance 16a06134-ea93-492f-a705-29cc31876c5d could not be found. Jun 23 11:45:48.954016 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: action_args: {'server_id': '16a06134-ea93-492f-a705-29cc31876c5d'} Jun 23 11:45:48.954933 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:45:48.954933 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:45:48.954933 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:45:48.954933 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:45:48.954933 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:45:48.954933 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:45:48.954933 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:45:48.954933 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:45:48.954933 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:45:48.954933 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:45:48.954933 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16a06134-ea93-492f-a705-29cc31876c5d could not be found. Jun 23 11:45:48.954933 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:45:48.954933 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:45:48.954933 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:45:48.954933 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:45:48.954933 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:45:48.954933 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:45:48.954933 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:45:48.954933 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:45:48.954933 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:45:48.960508 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:45:48.960508 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 23 11:45:48.960508 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 11:45:48.960508 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 23 11:45:48.960508 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 11:45:48.960508 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 23 11:45:48.960508 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 23 11:45:48.960508 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:45:48.960508 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:45:48.960508 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16a06134-ea93-492f-a705-29cc31876c5d could not be found. Jun 23 11:45:48.960508 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:45:48.960508 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:45:48.960508 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:45:48.960508 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:45:48.960508 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:45:48.960508 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:45:48.960508 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:45:48.960508 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:45:48.960508 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16a06134-ea93-492f-a705-29cc31876c5d could not be found. Jun 23 11:45:48.960508 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:45:48.961916 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-387a1f6f-ea15-4ff3-a072-d57567b84af4 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Returning 404 to user: Instance 16a06134-ea93-492f-a705-29cc31876c5d could not be found. {{(pid=124670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:45:48.961916 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-387a1f6f-ea15-4ff3-a072-d57567b84af4 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] 10.222.0.13 "GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.038448 Jun 23 11:45:48.961916 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 159/286] 10.222.0.13 () {58 vars in 1301 bytes} [Thu Jun 23 11:45:48 2022] GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d/os-volume_attachments => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 23 11:45:49.314361 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-4a917dab-6248-4124-96b5-323c72212b00 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:49.315095 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-4a917dab-6248-4124-96b5-323c72212b00 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 0953fa06-0916-418f-b527-06d088cc6066] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:49.322486 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-4a917dab-6248-4124-96b5-323c72212b00 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:49.323037 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-4a917dab-6248-4124-96b5-323c72212b00 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:49.323867 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-4a917dab-6248-4124-96b5-323c72212b00 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:49.324368 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-4a917dab-6248-4124-96b5-323c72212b00 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:49.464710 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-4a917dab-6248-4124-96b5-323c72212b00 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:49.475091 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-4a917dab-6248-4124-96b5-323c72212b00 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066" status: 200 len: 1522 microversion: 2.1 time: 0.163296 Jun 23 11:45:49.476017 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 128/287] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:49 2022] GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:45:50.493242 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-66f7f8bf-f036-4b95-97a2-d67111012423 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:50.494426 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-66f7f8bf-f036-4b95-97a2-d67111012423 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 0953fa06-0916-418f-b527-06d088cc6066] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:50.518216 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-66f7f8bf-f036-4b95-97a2-d67111012423 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:50.518923 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-66f7f8bf-f036-4b95-97a2-d67111012423 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:50.519704 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-66f7f8bf-f036-4b95-97a2-d67111012423 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:50.520165 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-66f7f8bf-f036-4b95-97a2-d67111012423 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:50.696196 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-66f7f8bf-f036-4b95-97a2-d67111012423 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:50.704466 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-66f7f8bf-f036-4b95-97a2-d67111012423 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066" status: 200 len: 1522 microversion: 2.1 time: 0.215599 Jun 23 11:45:50.705302 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 160/288] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:50 2022] GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066 => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:45:51.726369 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-ebb34bd9-e78e-48bc-8f7c-0b13f2a20b8b tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:51.727035 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-ebb34bd9-e78e-48bc-8f7c-0b13f2a20b8b tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 0953fa06-0916-418f-b527-06d088cc6066] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:51.734139 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ebb34bd9-e78e-48bc-8f7c-0b13f2a20b8b tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:51.737839 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ebb34bd9-e78e-48bc-8f7c-0b13f2a20b8b tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:51.737839 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ebb34bd9-e78e-48bc-8f7c-0b13f2a20b8b tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:51.737839 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ebb34bd9-e78e-48bc-8f7c-0b13f2a20b8b tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:51.871507 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-ebb34bd9-e78e-48bc-8f7c-0b13f2a20b8b tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:51.883154 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-ebb34bd9-e78e-48bc-8f7c-0b13f2a20b8b tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066" status: 200 len: 1522 microversion: 2.1 time: 0.163954 Jun 23 11:45:51.893864 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 129/289] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:51 2022] GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:45:52.900902 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-247014fc-f590-4d6a-9552-cdf74febeacd tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:52.902089 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-247014fc-f590-4d6a-9552-cdf74febeacd tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 0953fa06-0916-418f-b527-06d088cc6066] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:52.908529 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-247014fc-f590-4d6a-9552-cdf74febeacd tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:52.909246 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-247014fc-f590-4d6a-9552-cdf74febeacd tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:52.910023 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-247014fc-f590-4d6a-9552-cdf74febeacd tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:52.910459 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-247014fc-f590-4d6a-9552-cdf74febeacd tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:53.085381 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-247014fc-f590-4d6a-9552-cdf74febeacd tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:53.093128 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-247014fc-f590-4d6a-9552-cdf74febeacd tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066" status: 200 len: 1522 microversion: 2.1 time: 0.196048 Jun 23 11:45:53.102949 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 161/290] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:52 2022] GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066 => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:45:54.109440 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-b58ece9b-22a2-4864-b9b9-6af7b984069f tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:54.112396 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-b58ece9b-22a2-4864-b9b9-6af7b984069f tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 0953fa06-0916-418f-b527-06d088cc6066] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:54.117871 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-b58ece9b-22a2-4864-b9b9-6af7b984069f tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:54.118566 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-b58ece9b-22a2-4864-b9b9-6af7b984069f tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:54.119489 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-b58ece9b-22a2-4864-b9b9-6af7b984069f tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:54.120402 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-b58ece9b-22a2-4864-b9b9-6af7b984069f tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:54.311769 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-b58ece9b-22a2-4864-b9b9-6af7b984069f tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:54.319423 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-b58ece9b-22a2-4864-b9b9-6af7b984069f tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066" status: 200 len: 1522 microversion: 2.1 time: 0.213793 Jun 23 11:45:54.320086 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 130/291] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:54 2022] GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066 => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:45:55.338867 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-05b6f2f4-0ceb-4825-a899-00abb6d48575 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:55.340056 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-05b6f2f4-0ceb-4825-a899-00abb6d48575 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 0953fa06-0916-418f-b527-06d088cc6066] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:55.350606 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-05b6f2f4-0ceb-4825-a899-00abb6d48575 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:55.351456 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-05b6f2f4-0ceb-4825-a899-00abb6d48575 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:55.358944 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-05b6f2f4-0ceb-4825-a899-00abb6d48575 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:55.359347 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-05b6f2f4-0ceb-4825-a899-00abb6d48575 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:55.589370 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-6150792d-a446-4dd7-a1dd-bdaa2f1ec0f9 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:55.589870 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-6150792d-a446-4dd7-a1dd-bdaa2f1ec0f9 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] [instance: 16a06134-ea93-492f-a705-29cc31876c5d] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:55.596781 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-6150792d-a446-4dd7-a1dd-bdaa2f1ec0f9 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:55.597226 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-6150792d-a446-4dd7-a1dd-bdaa2f1ec0f9 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:55.597981 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-6150792d-a446-4dd7-a1dd-bdaa2f1ec0f9 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:55.598958 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-6150792d-a446-4dd7-a1dd-bdaa2f1ec0f9 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:55.615662 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.wsgi [None req-6150792d-a446-4dd7-a1dd-bdaa2f1ec0f9 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] HTTP exception thrown: Instance 16a06134-ea93-492f-a705-29cc31876c5d could not be found. Jun 23 11:45:55.617059 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-6150792d-a446-4dd7-a1dd-bdaa2f1ec0f9 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Request method failure captured: Jun 23 11:45:55.617059 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: request: DELETE /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d HTTP/1.1 Jun 23 11:45:55.617059 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Accept: application/json Jun 23 11:45:55.617059 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Accept-Encoding: identity Jun 23 11:45:55.617059 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Connection: close Jun 23 11:45:55.617059 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Content-Length: 0 Jun 23 11:45:55.617059 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Content-Type: application/json Jun 23 11:45:55.617059 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Host: 10.222.0.13 Jun 23 11:45:55.617059 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Openstack-System-Scope: None Jun 23 11:45:55.617059 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: User-Agent: python-urllib3/1.26.9 Jun 23 11:45:55.617059 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Auth-Token: gAAAAABitFIUL9DXw8PXhp-LbpHMVV8sz_VzQFwIww2XXk26XmYpGOqZf1_9T8lnjkbaxC6mcynN-ttRa9MgLEDxMQxFNnak2mvltFhQV_-vnUlrLSosO6MlepRFLu1a76iJI4o2NNk-UTXRTWLsoLrsC8x8vPuFM7n_GpT1H9Z_lVdoVjsa-4o Jun 23 11:45:55.617059 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Domain-Id: None Jun 23 11:45:55.617059 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Domain-Name: None Jun 23 11:45:55.617059 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Identity-Status: Confirmed Jun 23 11:45:55.617059 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Is-Admin-Project: True Jun 23 11:45:55.617059 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Domain-Id: default Jun 23 11:45:55.617059 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Domain-Name: Default Jun 23 11:45:55.617059 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Id: 515e65a705ee46cc8f8e03efbe58f177 Jun 23 11:45:55.617059 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Name: tempest-DeleteServersTestJSON-1774813048 Jun 23 11:45:55.617059 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Role: member,reader Jun 23 11:45:55.617059 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Roles: member,reader Jun 23 11:45:55.623599 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_515e65a705ee46cc8f8e03efbe58f177"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/515e65a705ee46cc8f8e03efbe58f177"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/515e65a705ee46cc8f8e03efbe58f177"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/515e65a705ee46cc8f8e03efbe58f177"}]}] Jun 23 11:45:55.623599 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant: tempest-DeleteServersTestJSON-1774813048 Jun 23 11:45:55.623599 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant-Id: 515e65a705ee46cc8f8e03efbe58f177 Jun 23 11:45:55.623599 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant-Name: tempest-DeleteServersTestJSON-1774813048 Jun 23 11:45:55.623599 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User: tempest-DeleteServersTestJSON-1774813048-project Jun 23 11:45:55.623599 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Domain-Id: default Jun 23 11:45:55.623599 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Domain-Name: Default Jun 23 11:45:55.623599 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Id: ae72d6c494ba4f16989adfe090803d47 Jun 23 11:45:55.623599 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Name: tempest-DeleteServersTestJSON-1774813048-project Jun 23 11:45:55.623599 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: method: > Jun 23 11:45:55.623599 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: exception: Instance 16a06134-ea93-492f-a705-29cc31876c5d could not be found. Jun 23 11:45:55.623599 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: action_args: {'id': '16a06134-ea93-492f-a705-29cc31876c5d'} Jun 23 11:45:55.624364 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:45:55.624364 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:45:55.624364 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:45:55.624364 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:45:55.624364 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:45:55.624364 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:45:55.624364 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:45:55.624364 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:45:55.624364 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:45:55.624364 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:45:55.624364 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16a06134-ea93-492f-a705-29cc31876c5d could not be found. Jun 23 11:45:55.624364 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:45:55.624364 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:45:55.624364 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:45:55.624364 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:45:55.624364 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:45:55.624364 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:45:55.624364 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:45:55.624364 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:45:55.624364 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:45:55.625666 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:45:55.625666 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 11:45:55.625666 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 11:45:55.625666 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 11:45:55.625666 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 11:45:55.625666 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:45:55.625666 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:45:55.625666 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:45:55.625666 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:45:55.625666 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16a06134-ea93-492f-a705-29cc31876c5d could not be found. Jun 23 11:45:55.625666 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:45:55.625666 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:45:55.625666 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:45:55.625666 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:45:55.625666 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:45:55.625666 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:45:55.625666 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:45:55.625666 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:45:55.625666 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16a06134-ea93-492f-a705-29cc31876c5d could not be found. Jun 23 11:45:55.625666 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:45:55.626837 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-6150792d-a446-4dd7-a1dd-bdaa2f1ec0f9 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Returning 404 to user: Instance 16a06134-ea93-492f-a705-29cc31876c5d could not be found. {{(pid=124669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:45:55.626837 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-6150792d-a446-4dd7-a1dd-bdaa2f1ec0f9 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] 10.222.0.13 "DELETE /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d" status: 404 len: 111 microversion: 2.1 time: 0.032982 Jun 23 11:45:55.626837 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 131/292] 10.222.0.13 () {58 vars in 1238 bytes} [Thu Jun 23 11:45:55 2022] DELETE /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 23 11:45:55.627915 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-04e8dbc3-f644-4925-9dce-aa840379c693 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:55.628733 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-04e8dbc3-f644-4925-9dce-aa840379c693 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] [instance: 16a06134-ea93-492f-a705-29cc31876c5d] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:55.637863 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-04e8dbc3-f644-4925-9dce-aa840379c693 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:55.638314 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-04e8dbc3-f644-4925-9dce-aa840379c693 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:55.639211 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-04e8dbc3-f644-4925-9dce-aa840379c693 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:55.639779 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-04e8dbc3-f644-4925-9dce-aa840379c693 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:55.656226 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.wsgi [None req-04e8dbc3-f644-4925-9dce-aa840379c693 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] HTTP exception thrown: Instance 16a06134-ea93-492f-a705-29cc31876c5d could not be found. Jun 23 11:45:55.657758 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-04e8dbc3-f644-4925-9dce-aa840379c693 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Request method failure captured: Jun 23 11:45:55.657758 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: request: GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d HTTP/1.1 Jun 23 11:45:55.657758 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Accept: application/json Jun 23 11:45:55.657758 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Accept-Encoding: identity Jun 23 11:45:55.657758 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Connection: close Jun 23 11:45:55.657758 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Content-Length: 0 Jun 23 11:45:55.657758 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Content-Type: application/json Jun 23 11:45:55.657758 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Host: 10.222.0.13 Jun 23 11:45:55.657758 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Openstack-System-Scope: None Jun 23 11:45:55.657758 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: User-Agent: python-urllib3/1.26.9 Jun 23 11:45:55.657758 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Auth-Token: gAAAAABitFIUL9DXw8PXhp-LbpHMVV8sz_VzQFwIww2XXk26XmYpGOqZf1_9T8lnjkbaxC6mcynN-ttRa9MgLEDxMQxFNnak2mvltFhQV_-vnUlrLSosO6MlepRFLu1a76iJI4o2NNk-UTXRTWLsoLrsC8x8vPuFM7n_GpT1H9Z_lVdoVjsa-4o Jun 23 11:45:55.657758 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Domain-Id: None Jun 23 11:45:55.657758 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Domain-Name: None Jun 23 11:45:55.657758 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Identity-Status: Confirmed Jun 23 11:45:55.657758 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Is-Admin-Project: True Jun 23 11:45:55.657758 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Domain-Id: default Jun 23 11:45:55.657758 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Domain-Name: Default Jun 23 11:45:55.657758 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Id: 515e65a705ee46cc8f8e03efbe58f177 Jun 23 11:45:55.657758 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Name: tempest-DeleteServersTestJSON-1774813048 Jun 23 11:45:55.657758 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Role: member,reader Jun 23 11:45:55.657758 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Roles: member,reader Jun 23 11:45:55.659269 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_515e65a705ee46cc8f8e03efbe58f177"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/515e65a705ee46cc8f8e03efbe58f177"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/515e65a705ee46cc8f8e03efbe58f177"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/515e65a705ee46cc8f8e03efbe58f177"}]}] Jun 23 11:45:55.659269 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant: tempest-DeleteServersTestJSON-1774813048 Jun 23 11:45:55.659269 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant-Id: 515e65a705ee46cc8f8e03efbe58f177 Jun 23 11:45:55.659269 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant-Name: tempest-DeleteServersTestJSON-1774813048 Jun 23 11:45:55.659269 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User: tempest-DeleteServersTestJSON-1774813048-project Jun 23 11:45:55.659269 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Domain-Id: default Jun 23 11:45:55.659269 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Domain-Name: Default Jun 23 11:45:55.659269 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Id: ae72d6c494ba4f16989adfe090803d47 Jun 23 11:45:55.659269 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Name: tempest-DeleteServersTestJSON-1774813048-project Jun 23 11:45:55.659269 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: method: > Jun 23 11:45:55.659269 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: exception: Instance 16a06134-ea93-492f-a705-29cc31876c5d could not be found. Jun 23 11:45:55.659269 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: action_args: {'id': '16a06134-ea93-492f-a705-29cc31876c5d'} Jun 23 11:45:55.659934 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:45:55.659934 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:45:55.659934 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:45:55.659934 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:45:55.659934 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:45:55.659934 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:45:55.659934 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:45:55.659934 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:45:55.659934 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:45:55.659934 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:45:55.659934 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16a06134-ea93-492f-a705-29cc31876c5d could not be found. Jun 23 11:45:55.659934 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:45:55.659934 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:45:55.659934 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:45:55.659934 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:45:55.659934 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:45:55.659934 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:45:55.659934 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:45:55.659934 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:45:55.659934 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:45:55.661649 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:45:55.661649 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 11:45:55.661649 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 11:45:55.661649 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:45:55.661649 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:45:55.661649 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:45:55.661649 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:45:55.661649 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16a06134-ea93-492f-a705-29cc31876c5d could not be found. Jun 23 11:45:55.661649 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:45:55.661649 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:45:55.661649 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:45:55.661649 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:45:55.661649 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:45:55.661649 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:45:55.661649 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:45:55.661649 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:45:55.661649 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16a06134-ea93-492f-a705-29cc31876c5d could not be found. Jun 23 11:45:55.661649 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:45:55.668769 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-04e8dbc3-f644-4925-9dce-aa840379c693 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] Returning 404 to user: Instance 16a06134-ea93-492f-a705-29cc31876c5d could not be found. {{(pid=124669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:45:55.668769 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-04e8dbc3-f644-4925-9dce-aa840379c693 tempest-DeleteServersTestJSON-1774813048 tempest-DeleteServersTestJSON-1774813048-project] 10.222.0.13 "GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d" status: 404 len: 111 microversion: 2.1 time: 0.036909 Jun 23 11:45:55.668769 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 132/293] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:55 2022] GET /compute/v2.1/servers/16a06134-ea93-492f-a705-29cc31876c5d => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:45:55.875490 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-05b6f2f4-0ceb-4825-a899-00abb6d48575 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:55.895804 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-05b6f2f4-0ceb-4825-a899-00abb6d48575 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066" status: 200 len: 1522 microversion: 2.1 time: 0.562384 Jun 23 11:45:55.917443 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 162/294] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:55 2022] GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066 => generated 1522 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:45:56.936452 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-2686bb6b-1652-4bba-a360-17e3aff1a809 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:56.937586 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-2686bb6b-1652-4bba-a360-17e3aff1a809 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 0953fa06-0916-418f-b527-06d088cc6066] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:56.957404 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-2686bb6b-1652-4bba-a360-17e3aff1a809 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:56.961117 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-2686bb6b-1652-4bba-a360-17e3aff1a809 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:56.971700 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-2686bb6b-1652-4bba-a360-17e3aff1a809 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:56.972500 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-2686bb6b-1652-4bba-a360-17e3aff1a809 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:57.258824 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-2686bb6b-1652-4bba-a360-17e3aff1a809 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:57.267924 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-2686bb6b-1652-4bba-a360-17e3aff1a809 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066" status: 200 len: 1522 microversion: 2.1 time: 0.348388 Jun 23 11:45:57.272085 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 133/295] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:56 2022] GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066 => generated 1522 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:45:58.297400 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-edc01623-c838-4683-9e36-e8a7414a84f8 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:58.298015 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-edc01623-c838-4683-9e36-e8a7414a84f8 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 0953fa06-0916-418f-b527-06d088cc6066] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:58.320106 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-edc01623-c838-4683-9e36-e8a7414a84f8 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:58.323532 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-edc01623-c838-4683-9e36-e8a7414a84f8 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:58.328904 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-edc01623-c838-4683-9e36-e8a7414a84f8 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:58.329625 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-edc01623-c838-4683-9e36-e8a7414a84f8 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:58.586502 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-edc01623-c838-4683-9e36-e8a7414a84f8 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:58.600536 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-edc01623-c838-4683-9e36-e8a7414a84f8 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066" status: 200 len: 1522 microversion: 2.1 time: 0.308927 Jun 23 11:45:58.600536 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 163/296] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:58 2022] GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066 => generated 1522 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:45:59.617455 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-64ee8dd6-1451-4e28-aa38-d04baa7b6727 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:45:59.619754 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-64ee8dd6-1451-4e28-aa38-d04baa7b6727 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 0953fa06-0916-418f-b527-06d088cc6066] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:45:59.626992 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-64ee8dd6-1451-4e28-aa38-d04baa7b6727 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:59.634755 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-64ee8dd6-1451-4e28-aa38-d04baa7b6727 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:59.635858 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-64ee8dd6-1451-4e28-aa38-d04baa7b6727 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:45:59.636501 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-64ee8dd6-1451-4e28-aa38-d04baa7b6727 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:45:59.962691 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-64ee8dd6-1451-4e28-aa38-d04baa7b6727 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:45:59.977688 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-64ee8dd6-1451-4e28-aa38-d04baa7b6727 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066" status: 200 len: 1522 microversion: 2.1 time: 0.361302 Jun 23 11:45:59.994080 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 134/297] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:45:59 2022] GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066 => generated 1522 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:46:01.004050 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-0694585c-eb7b-4423-b464-bbaa800addeb tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:46:01.005315 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-0694585c-eb7b-4423-b464-bbaa800addeb tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 0953fa06-0916-418f-b527-06d088cc6066] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:46:01.016906 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_api:SELECT=56 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:46:01.019306 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-0694585c-eb7b-4423-b464-bbaa800addeb tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:01.020759 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-0694585c-eb7b-4423-b464-bbaa800addeb tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:01.021775 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-0694585c-eb7b-4423-b464-bbaa800addeb tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:01.022372 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-0694585c-eb7b-4423-b464-bbaa800addeb tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:01.455642 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-0694585c-eb7b-4423-b464-bbaa800addeb tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:01.482124 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-0694585c-eb7b-4423-b464-bbaa800addeb tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066" status: 200 len: 1522 microversion: 2.1 time: 0.488750 Jun 23 11:46:01.484173 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 164/298] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:46:00 2022] GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066 => generated 1522 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:46:02.502952 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-6592455d-4de3-43eb-9ae9-bb34299ea56d tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:46:02.504968 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-6592455d-4de3-43eb-9ae9-bb34299ea56d tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 0953fa06-0916-418f-b527-06d088cc6066] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:46:02.511971 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:46:02.517053 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-6592455d-4de3-43eb-9ae9-bb34299ea56d tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:02.517522 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-6592455d-4de3-43eb-9ae9-bb34299ea56d tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:02.518369 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-6592455d-4de3-43eb-9ae9-bb34299ea56d tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:02.518862 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-6592455d-4de3-43eb-9ae9-bb34299ea56d tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:02.936430 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-6592455d-4de3-43eb-9ae9-bb34299ea56d tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:02.945374 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-6592455d-4de3-43eb-9ae9-bb34299ea56d tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066" status: 200 len: 1522 microversion: 2.1 time: 0.449492 Jun 23 11:46:02.946206 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 135/299] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:46:02 2022] GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066 => generated 1522 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:46:02.953567 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-d8bf09bb-9fee-421c-8175-695a835072ec tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Action: 'create', calling method: .version_select at 0x7f5d06850dc0>, body: {"keypair": {"name": "tempest-TestShelveInstance-464325998", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN5Geyrogm+AXM6IKpVIcK/kyw9Y9GwvQ162/1mhbf2uQ4By/04z7ZP7W9svT4k27pR19YQdaK7NiIMVdGE1szuiVe17N5hoyAosVu1tDUXWLZ37yhmV+SG8NX3GjkOIVw=="}} {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:46:02.968259 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.quota [None req-d8bf09bb-9fee-421c-8175-695a835072ec tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Getting quotas for project ce01d9a78d3f4bb7b101b47548b73037. Resources: {'key_pairs'} {{(pid=124670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:46:02.973620 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.quota [None req-d8bf09bb-9fee-421c-8175-695a835072ec tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Getting quotas for user 626c3dbdc0f1407db82d6988e68e40b2 and project ce01d9a78d3f4bb7b101b47548b73037. Resources: {'key_pairs'} {{(pid=124670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:46:03.084719 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-d8bf09bb-9fee-421c-8175-695a835072ec tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.398677 Jun 23 11:46:03.086652 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 165/300] 10.222.0.13 () {60 vars in 1158 bytes} [Thu Jun 23 11:46:02 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:46:03.963658 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-dc90d811-3957-42e7-b4fc-aef089cb8aeb tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:46:03.964421 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-dc90d811-3957-42e7-b4fc-aef089cb8aeb tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 0953fa06-0916-418f-b527-06d088cc6066] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:46:03.975055 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-dc90d811-3957-42e7-b4fc-aef089cb8aeb tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:03.975606 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-dc90d811-3957-42e7-b4fc-aef089cb8aeb tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:03.976542 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-dc90d811-3957-42e7-b4fc-aef089cb8aeb tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:03.977084 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-dc90d811-3957-42e7-b4fc-aef089cb8aeb tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:04.181521 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-dc90d811-3957-42e7-b4fc-aef089cb8aeb tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:04.190185 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-dc90d811-3957-42e7-b4fc-aef089cb8aeb tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066" status: 200 len: 1502 microversion: 2.1 time: 0.230850 Jun 23 11:46:04.193803 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 136/301] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:46:03 2022] GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066 => generated 1502 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:46:04.208117 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-434b6b94-0370-4d19-9c8f-512b256ef705 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:46:04.208844 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-434b6b94-0370-4d19-9c8f-512b256ef705 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 762e880e-7ec3-41bb-aac7-fa05de4efd11] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:46:04.222563 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-434b6b94-0370-4d19-9c8f-512b256ef705 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:04.222563 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-434b6b94-0370-4d19-9c8f-512b256ef705 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:04.222563 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-434b6b94-0370-4d19-9c8f-512b256ef705 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:04.223040 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-434b6b94-0370-4d19-9c8f-512b256ef705 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:04.400332 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-434b6b94-0370-4d19-9c8f-512b256ef705 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:04.409208 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-434b6b94-0370-4d19-9c8f-512b256ef705 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/762e880e-7ec3-41bb-aac7-fa05de4efd11" status: 200 len: 1515 microversion: 2.1 time: 0.205068 Jun 23 11:46:04.410088 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 166/302] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:46:04 2022] GET /compute/v2.1/servers/762e880e-7ec3-41bb-aac7-fa05de4efd11 => generated 1515 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:46:08.351792 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-bb64ee05-19ae-4670-8cd7-ec964b932c60 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:46:08.353274 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-bb64ee05-19ae-4670-8cd7-ec964b932c60 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 762e880e-7ec3-41bb-aac7-fa05de4efd11] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:46:08.370465 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-bb64ee05-19ae-4670-8cd7-ec964b932c60 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:08.376827 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-bb64ee05-19ae-4670-8cd7-ec964b932c60 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:08.378152 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-bb64ee05-19ae-4670-8cd7-ec964b932c60 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:08.378744 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-bb64ee05-19ae-4670-8cd7-ec964b932c60 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:08.411641 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.objects.instance [None req-bb64ee05-19ae-4670-8cd7-ec964b932c60 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lazy-loading 'flavor' on Instance uuid 762e880e-7ec3-41bb-aac7-fa05de4efd11 {{(pid=124669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:46:08.849926 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-bb64ee05-19ae-4670-8cd7-ec964b932c60 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "POST /compute/v2.1/servers/762e880e-7ec3-41bb-aac7-fa05de4efd11/action" status: 200 len: 32 microversion: 2.1 time: 0.502819 Jun 23 11:46:08.856702 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 137/303] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Jun 23 11:46:08 2022] POST /compute/v2.1/servers/762e880e-7ec3-41bb-aac7-fa05de4efd11/action => generated 32 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 11:46:08.875428 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-d5ed72e3-78db-4f98-8c03-521baa410b72 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:46:08.877659 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-d5ed72e3-78db-4f98-8c03-521baa410b72 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 762e880e-7ec3-41bb-aac7-fa05de4efd11] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:46:08.902060 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-d5ed72e3-78db-4f98-8c03-521baa410b72 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:08.903562 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-d5ed72e3-78db-4f98-8c03-521baa410b72 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:08.904582 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-d5ed72e3-78db-4f98-8c03-521baa410b72 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:08.907245 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-d5ed72e3-78db-4f98-8c03-521baa410b72 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:09.158069 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-d5ed72e3-78db-4f98-8c03-521baa410b72 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:09.179893 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-d5ed72e3-78db-4f98-8c03-521baa410b72 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/762e880e-7ec3-41bb-aac7-fa05de4efd11" status: 200 len: 1521 microversion: 2.1 time: 0.314645 Jun 23 11:46:09.180994 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 167/304] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:46:08 2022] GET /compute/v2.1/servers/762e880e-7ec3-41bb-aac7-fa05de4efd11 => generated 1521 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:46:10.200737 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-df91ec0d-dfc6-426b-9751-15d8c85018c9 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:46:10.205227 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-df91ec0d-dfc6-426b-9751-15d8c85018c9 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 762e880e-7ec3-41bb-aac7-fa05de4efd11] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:46:10.215561 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-df91ec0d-dfc6-426b-9751-15d8c85018c9 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:10.217072 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-df91ec0d-dfc6-426b-9751-15d8c85018c9 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:10.218269 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-df91ec0d-dfc6-426b-9751-15d8c85018c9 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:10.218922 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-df91ec0d-dfc6-426b-9751-15d8c85018c9 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:10.386838 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-df91ec0d-dfc6-426b-9751-15d8c85018c9 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:10.396127 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-df91ec0d-dfc6-426b-9751-15d8c85018c9 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/762e880e-7ec3-41bb-aac7-fa05de4efd11" status: 200 len: 1521 microversion: 2.1 time: 0.201868 Jun 23 11:46:10.407100 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 138/305] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:46:10 2022] GET /compute/v2.1/servers/762e880e-7ec3-41bb-aac7-fa05de4efd11 => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:46:11.402136 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-eead7c30-46ae-4b0a-93d4-fde389438c6f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Action: 'create', calling method: .version_select at 0x7f5d06850c10>, body: {"keypair": {"name": "tempest-keypair-834820437", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCfTljLTaboX1ONkT3t5C/v0rSHcqw8AO950d/yjSY9h79Z9nvod/Rl5qMLvpHJFqcrekfdkMOT8sYOcukZYjNHfwGQKCpIVqc9a8VcohWE4ezW7nEIll2zmRFI4nvVTFA=="}} {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:46:11.414346 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-71a66de9-aac6-4879-8b44-a6cb2080ac0d tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:46:11.415098 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-71a66de9-aac6-4879-8b44-a6cb2080ac0d tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 762e880e-7ec3-41bb-aac7-fa05de4efd11] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:46:11.418637 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.quota [None req-eead7c30-46ae-4b0a-93d4-fde389438c6f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Getting quotas for project 4c0275f5304e4d9eae19c46a4f161217. Resources: {'key_pairs'} {{(pid=124670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:46:11.422734 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.quota [None req-eead7c30-46ae-4b0a-93d4-fde389438c6f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Getting quotas for user 41cb2b9a5156470aaeca9cc10f402ef9 and project 4c0275f5304e4d9eae19c46a4f161217. Resources: {'key_pairs'} {{(pid=124670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:46:11.423310 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-71a66de9-aac6-4879-8b44-a6cb2080ac0d tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:11.431061 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-71a66de9-aac6-4879-8b44-a6cb2080ac0d tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:11.431061 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-71a66de9-aac6-4879-8b44-a6cb2080ac0d tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:11.431061 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-71a66de9-aac6-4879-8b44-a6cb2080ac0d tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:11.549487 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-eead7c30-46ae-4b0a-93d4-fde389438c6f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.322929 Jun 23 11:46:11.550224 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 168/306] 10.222.0.13 () {62 vars in 1199 bytes} [Thu Jun 23 11:46:11 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 327 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jun 23 11:46:11.610567 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-71a66de9-aac6-4879-8b44-a6cb2080ac0d tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:11.622184 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-71a66de9-aac6-4879-8b44-a6cb2080ac0d tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/762e880e-7ec3-41bb-aac7-fa05de4efd11" status: 200 len: 1521 microversion: 2.1 time: 0.212439 Jun 23 11:46:11.622814 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 139/307] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:46:11 2022] GET /compute/v2.1/servers/762e880e-7ec3-41bb-aac7-fa05de4efd11 => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:46:12.642991 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-58f408a1-d80f-4f75-8c14-fe8e42c2f8c4 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:46:12.649117 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-58f408a1-d80f-4f75-8c14-fe8e42c2f8c4 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 762e880e-7ec3-41bb-aac7-fa05de4efd11] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:46:12.651280 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-58f408a1-d80f-4f75-8c14-fe8e42c2f8c4 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:12.651865 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-58f408a1-d80f-4f75-8c14-fe8e42c2f8c4 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:12.652534 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-58f408a1-d80f-4f75-8c14-fe8e42c2f8c4 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:12.652982 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-58f408a1-d80f-4f75-8c14-fe8e42c2f8c4 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:12.659960 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_cell1:SELECT=89 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:46:12.852007 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-58f408a1-d80f-4f75-8c14-fe8e42c2f8c4 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:12.859766 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-58f408a1-d80f-4f75-8c14-fe8e42c2f8c4 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/762e880e-7ec3-41bb-aac7-fa05de4efd11" status: 200 len: 1521 microversion: 2.1 time: 0.220781 Jun 23 11:46:12.860442 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 169/308] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:46:12 2022] GET /compute/v2.1/servers/762e880e-7ec3-41bb-aac7-fa05de4efd11 => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:46:13.877211 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-70ec328a-a127-4935-9472-387936072f54 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:46:13.877828 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-70ec328a-a127-4935-9472-387936072f54 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 762e880e-7ec3-41bb-aac7-fa05de4efd11] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:46:13.885744 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-70ec328a-a127-4935-9472-387936072f54 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:13.886195 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-70ec328a-a127-4935-9472-387936072f54 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:13.887031 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-70ec328a-a127-4935-9472-387936072f54 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:13.887465 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-70ec328a-a127-4935-9472-387936072f54 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:14.030398 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-70ec328a-a127-4935-9472-387936072f54 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:14.034337 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-70ec328a-a127-4935-9472-387936072f54 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/762e880e-7ec3-41bb-aac7-fa05de4efd11" status: 200 len: 1521 microversion: 2.1 time: 0.161003 Jun 23 11:46:14.035000 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 140/309] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:46:13 2022] GET /compute/v2.1/servers/762e880e-7ec3-41bb-aac7-fa05de4efd11 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:46:14.071911 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-4cbbff61-9ae4-4519-b863-a21be72e440a tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-557710307", "imageRef": "b19d6f23-214c-4432-bee6-455978023759", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f03946f1-997c-47c6-9ad6-e4221a2ca301"}], "security_groups": [{"name": "tempest-securitygroup--1944560"}], "key_name": "tempest-keypair-834820437", "user_data": "}} {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:46:14.171419 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.network.neutron [None req-4cbbff61-9ae4-4519-b863-a21be72e440a tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] validate_networks() for [('f03946f1-997c-47c6-9ad6-e4221a2ca301', None, None, None, None, None)] {{(pid=124670) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 11:46:14.793523 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.virt.hardware [None req-4cbbff61-9ae4-4519-b863-a21be72e440a tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Flavor limits 0:0:0 {{(pid=124670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 11:46:14.793756 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.virt.hardware [None req-4cbbff61-9ae4-4519-b863-a21be72e440a tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Image limits 0:0:0 {{(pid=124670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 11:46:14.794271 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.virt.hardware [None req-4cbbff61-9ae4-4519-b863-a21be72e440a tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Flavor pref 0:0:0 {{(pid=124670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 11:46:14.794858 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.virt.hardware [None req-4cbbff61-9ae4-4519-b863-a21be72e440a tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Image pref 0:0:0 {{(pid=124670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 11:46:14.795265 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.virt.hardware [None req-4cbbff61-9ae4-4519-b863-a21be72e440a tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 11:46:14.805445 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-4cbbff61-9ae4-4519-b863-a21be72e440a tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:14.806112 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-4cbbff61-9ae4-4519-b863-a21be72e440a tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:14.807077 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-4cbbff61-9ae4-4519-b863-a21be72e440a tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:14.807674 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-4cbbff61-9ae4-4519-b863-a21be72e440a tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:14.830046 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.quota [None req-4cbbff61-9ae4-4519-b863-a21be72e440a tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Getting quotas for project 4c0275f5304e4d9eae19c46a4f161217. Resources: {'cores', 'instances', 'ram'} {{(pid=124670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:46:14.834950 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.quota [None req-4cbbff61-9ae4-4519-b863-a21be72e440a tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Getting quotas for user 41cb2b9a5156470aaeca9cc10f402ef9 and project 4c0275f5304e4d9eae19c46a4f161217. Resources: {'cores', 'instances', 'ram'} {{(pid=124670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:46:14.846575 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-4cbbff61-9ae4-4519-b863-a21be72e440a tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Going to run 1 instances... {{(pid=124670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 11:46:14.848845 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-4cbbff61-9ae4-4519-b863-a21be72e440a tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b19d6f23-214c-4432-bee6-455978023759',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 11:46:15.009849 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-4cbbff61-9ae4-4519-b863-a21be72e440a tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.20 time: 0.943540 Jun 23 11:46:15.010926 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 170/310] 10.222.0.13 () {62 vars in 1187 bytes} [Thu Jun 23 11:46:14 2022] POST /compute/v2.1/servers => generated 399 bytes in 945 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jun 23 11:46:15.021035 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-c284b744-2426-42eb-8db5-0257ff7f1274 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:46:15.021957 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-c284b744-2426-42eb-8db5-0257ff7f1274 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:46:15.056477 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-34bd1254-6ebe-4997-8816-5620ba7af78d tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:46:15.057467 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-34bd1254-6ebe-4997-8816-5620ba7af78d tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 762e880e-7ec3-41bb-aac7-fa05de4efd11] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:46:15.072706 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-34bd1254-6ebe-4997-8816-5620ba7af78d tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:15.073354 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-34bd1254-6ebe-4997-8816-5620ba7af78d tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:15.073894 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-34bd1254-6ebe-4997-8816-5620ba7af78d tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:15.074505 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-34bd1254-6ebe-4997-8816-5620ba7af78d tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:15.101520 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-c284b744-2426-42eb-8db5-0257ff7f1274 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:15.111884 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-c284b744-2426-42eb-8db5-0257ff7f1274 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:15.117482 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-c284b744-2426-42eb-8db5-0257ff7f1274 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:15.123694 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-c284b744-2426-42eb-8db5-0257ff7f1274 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1280 microversion: 2.20 time: 0.098218 Jun 23 11:46:15.125149 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 141/311] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:46:15 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1280 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:46:15.249289 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-34bd1254-6ebe-4997-8816-5620ba7af78d tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:15.257385 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-34bd1254-6ebe-4997-8816-5620ba7af78d tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/762e880e-7ec3-41bb-aac7-fa05de4efd11" status: 200 len: 1521 microversion: 2.1 time: 0.207368 Jun 23 11:46:15.257960 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 171/312] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:46:15 2022] GET /compute/v2.1/servers/762e880e-7ec3-41bb-aac7-fa05de4efd11 => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:46:16.141957 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-a7a983ec-bef2-42aa-b30b-3886656997e4 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:46:16.142709 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-a7a983ec-bef2-42aa-b30b-3886656997e4 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:46:16.200967 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-a7a983ec-bef2-42aa-b30b-3886656997e4 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:16.210007 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-a7a983ec-bef2-42aa-b30b-3886656997e4 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:16.211865 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-a7a983ec-bef2-42aa-b30b-3886656997e4 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:16.213104 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-a7a983ec-bef2-42aa-b30b-3886656997e4 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1280 microversion: 2.20 time: 0.075535 Jun 23 11:46:16.213766 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 142/313] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:46:16 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1280 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:46:16.281986 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-f908d17b-c031-450c-86fd-4abed94d03e5 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:46:16.286553 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-f908d17b-c031-450c-86fd-4abed94d03e5 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 762e880e-7ec3-41bb-aac7-fa05de4efd11] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:46:16.301993 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-f908d17b-c031-450c-86fd-4abed94d03e5 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:16.304598 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-f908d17b-c031-450c-86fd-4abed94d03e5 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:16.306079 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-f908d17b-c031-450c-86fd-4abed94d03e5 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:16.306978 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-f908d17b-c031-450c-86fd-4abed94d03e5 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:16.451995 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-f908d17b-c031-450c-86fd-4abed94d03e5 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:16.460789 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-f908d17b-c031-450c-86fd-4abed94d03e5 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/762e880e-7ec3-41bb-aac7-fa05de4efd11" status: 200 len: 1521 microversion: 2.1 time: 0.189069 Jun 23 11:46:16.461361 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 172/314] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:46:16 2022] GET /compute/v2.1/servers/762e880e-7ec3-41bb-aac7-fa05de4efd11 => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:46:17.232075 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-ae61fe25-5e13-455d-b84a-022ca0be05b6 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:46:17.232678 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-ae61fe25-5e13-455d-b84a-022ca0be05b6 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:46:17.239320 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ae61fe25-5e13-455d-b84a-022ca0be05b6 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:17.239759 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ae61fe25-5e13-455d-b84a-022ca0be05b6 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:17.240506 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ae61fe25-5e13-455d-b84a-022ca0be05b6 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:17.240940 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ae61fe25-5e13-455d-b84a-022ca0be05b6 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:17.304022 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-ae61fe25-5e13-455d-b84a-022ca0be05b6 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:17.306337 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:46:17.312631 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-ae61fe25-5e13-455d-b84a-022ca0be05b6 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:17.317464 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-ae61fe25-5e13-455d-b84a-022ca0be05b6 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:17.317464 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-ae61fe25-5e13-455d-b84a-022ca0be05b6 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1284 microversion: 2.20 time: 0.086985 Jun 23 11:46:17.317464 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 143/315] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:46:17 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:46:17.478215 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-b506109f-45af-46e3-82a2-f93e0839ccab tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:46:17.478858 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-b506109f-45af-46e3-82a2-f93e0839ccab tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 762e880e-7ec3-41bb-aac7-fa05de4efd11] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:46:17.485149 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-b506109f-45af-46e3-82a2-f93e0839ccab tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:17.485531 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-b506109f-45af-46e3-82a2-f93e0839ccab tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:17.486591 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-b506109f-45af-46e3-82a2-f93e0839ccab tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:17.487237 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-b506109f-45af-46e3-82a2-f93e0839ccab tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:17.620549 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-b506109f-45af-46e3-82a2-f93e0839ccab tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:17.628678 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-b506109f-45af-46e3-82a2-f93e0839ccab tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/762e880e-7ec3-41bb-aac7-fa05de4efd11" status: 200 len: 1521 microversion: 2.1 time: 0.154255 Jun 23 11:46:17.635808 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 173/316] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:46:17 2022] GET /compute/v2.1/servers/762e880e-7ec3-41bb-aac7-fa05de4efd11 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:46:18.334405 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-7e913d9e-778a-45ce-86f4-3441e6160d1f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:46:18.335042 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-7e913d9e-778a-45ce-86f4-3441e6160d1f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:46:18.342483 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-7e913d9e-778a-45ce-86f4-3441e6160d1f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:18.342969 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-7e913d9e-778a-45ce-86f4-3441e6160d1f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:18.343730 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-7e913d9e-778a-45ce-86f4-3441e6160d1f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:18.344160 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-7e913d9e-778a-45ce-86f4-3441e6160d1f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:18.406764 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-7e913d9e-778a-45ce-86f4-3441e6160d1f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:18.415677 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-7e913d9e-778a-45ce-86f4-3441e6160d1f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:18.417234 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-7e913d9e-778a-45ce-86f4-3441e6160d1f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:18.418327 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-7e913d9e-778a-45ce-86f4-3441e6160d1f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1284 microversion: 2.20 time: 0.089022 Jun 23 11:46:18.418915 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 144/317] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:46:18 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:46:18.654200 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-974a3dd3-44a8-4be3-9e5b-9ce3b9f156b9 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:46:18.654870 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-974a3dd3-44a8-4be3-9e5b-9ce3b9f156b9 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 762e880e-7ec3-41bb-aac7-fa05de4efd11] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:46:18.661584 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-974a3dd3-44a8-4be3-9e5b-9ce3b9f156b9 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:18.662047 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-974a3dd3-44a8-4be3-9e5b-9ce3b9f156b9 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:18.662846 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-974a3dd3-44a8-4be3-9e5b-9ce3b9f156b9 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:18.663306 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-974a3dd3-44a8-4be3-9e5b-9ce3b9f156b9 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:18.815847 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-974a3dd3-44a8-4be3-9e5b-9ce3b9f156b9 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:18.830927 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-974a3dd3-44a8-4be3-9e5b-9ce3b9f156b9 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/762e880e-7ec3-41bb-aac7-fa05de4efd11" status: 200 len: 1521 microversion: 2.1 time: 0.180440 Jun 23 11:46:18.833504 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 174/318] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:46:18 2022] GET /compute/v2.1/servers/762e880e-7ec3-41bb-aac7-fa05de4efd11 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:46:19.437776 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-98ef68fb-a22d-4e14-a01c-a858a13f396f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:46:19.438605 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-98ef68fb-a22d-4e14-a01c-a858a13f396f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:46:19.446784 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-98ef68fb-a22d-4e14-a01c-a858a13f396f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:19.447416 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-98ef68fb-a22d-4e14-a01c-a858a13f396f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:19.448185 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-98ef68fb-a22d-4e14-a01c-a858a13f396f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:19.448840 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-98ef68fb-a22d-4e14-a01c-a858a13f396f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:19.520448 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-98ef68fb-a22d-4e14-a01c-a858a13f396f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:19.528645 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-98ef68fb-a22d-4e14-a01c-a858a13f396f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:19.530150 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-98ef68fb-a22d-4e14-a01c-a858a13f396f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:19.531288 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-98ef68fb-a22d-4e14-a01c-a858a13f396f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1350 microversion: 2.20 time: 0.098672 Jun 23 11:46:19.531837 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 145/319] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:46:19 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1350 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:46:19.851550 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-033db44d-c334-498c-8f52-1280445ee916 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:46:19.852671 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-033db44d-c334-498c-8f52-1280445ee916 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 762e880e-7ec3-41bb-aac7-fa05de4efd11] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:46:19.860326 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-033db44d-c334-498c-8f52-1280445ee916 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:19.860900 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-033db44d-c334-498c-8f52-1280445ee916 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:19.861925 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-033db44d-c334-498c-8f52-1280445ee916 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:19.862641 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-033db44d-c334-498c-8f52-1280445ee916 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:20.021912 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-033db44d-c334-498c-8f52-1280445ee916 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:20.029540 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-033db44d-c334-498c-8f52-1280445ee916 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/762e880e-7ec3-41bb-aac7-fa05de4efd11" status: 200 len: 1521 microversion: 2.1 time: 0.182802 Jun 23 11:46:20.030270 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 175/320] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:46:19 2022] GET /compute/v2.1/servers/762e880e-7ec3-41bb-aac7-fa05de4efd11 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:46:20.550516 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-e1323afd-5ec2-455c-b2e5-7cf11da6654d tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:46:20.551337 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-e1323afd-5ec2-455c-b2e5-7cf11da6654d tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:46:20.558500 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-e1323afd-5ec2-455c-b2e5-7cf11da6654d tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:20.559008 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-e1323afd-5ec2-455c-b2e5-7cf11da6654d tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:20.559770 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-e1323afd-5ec2-455c-b2e5-7cf11da6654d tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:20.560202 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-e1323afd-5ec2-455c-b2e5-7cf11da6654d tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:20.696551 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-e1323afd-5ec2-455c-b2e5-7cf11da6654d tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:20.704896 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-e1323afd-5ec2-455c-b2e5-7cf11da6654d tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:20.706385 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-e1323afd-5ec2-455c-b2e5-7cf11da6654d tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:20.707635 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-e1323afd-5ec2-455c-b2e5-7cf11da6654d tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1403 microversion: 2.20 time: 0.161105 Jun 23 11:46:20.708748 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 146/321] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:46:20 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1403 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:46:21.048444 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-77b875fb-e998-4ba6-aaaa-79533db800a1 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:46:21.049582 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-77b875fb-e998-4ba6-aaaa-79533db800a1 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 762e880e-7ec3-41bb-aac7-fa05de4efd11] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:46:21.056061 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-77b875fb-e998-4ba6-aaaa-79533db800a1 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:21.056505 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-77b875fb-e998-4ba6-aaaa-79533db800a1 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:21.057259 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-77b875fb-e998-4ba6-aaaa-79533db800a1 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:21.057689 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-77b875fb-e998-4ba6-aaaa-79533db800a1 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:21.208536 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-77b875fb-e998-4ba6-aaaa-79533db800a1 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:21.221851 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-77b875fb-e998-4ba6-aaaa-79533db800a1 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/762e880e-7ec3-41bb-aac7-fa05de4efd11" status: 200 len: 1521 microversion: 2.1 time: 0.176455 Jun 23 11:46:21.233440 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 176/322] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:46:21 2022] GET /compute/v2.1/servers/762e880e-7ec3-41bb-aac7-fa05de4efd11 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:46:21.727658 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-233a05b9-c974-4f52-8c77-33b8e5f051de tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:46:21.728396 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-233a05b9-c974-4f52-8c77-33b8e5f051de tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:46:21.734311 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-233a05b9-c974-4f52-8c77-33b8e5f051de tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:21.734788 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-233a05b9-c974-4f52-8c77-33b8e5f051de tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:21.736652 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-233a05b9-c974-4f52-8c77-33b8e5f051de tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:21.736652 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-233a05b9-c974-4f52-8c77-33b8e5f051de tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:21.871905 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-233a05b9-c974-4f52-8c77-33b8e5f051de tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:21.880845 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-233a05b9-c974-4f52-8c77-33b8e5f051de tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:21.882330 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-233a05b9-c974-4f52-8c77-33b8e5f051de tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:21.883457 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-233a05b9-c974-4f52-8c77-33b8e5f051de tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1403 microversion: 2.20 time: 0.160922 Jun 23 11:46:21.884001 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 147/323] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:46:21 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1403 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:46:22.239605 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-7fe93c88-f6e7-4e98-ba5b-09f26ac287f0 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:46:22.240355 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-7fe93c88-f6e7-4e98-ba5b-09f26ac287f0 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 762e880e-7ec3-41bb-aac7-fa05de4efd11] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:46:22.249877 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-7fe93c88-f6e7-4e98-ba5b-09f26ac287f0 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:22.249877 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-7fe93c88-f6e7-4e98-ba5b-09f26ac287f0 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:22.249877 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-7fe93c88-f6e7-4e98-ba5b-09f26ac287f0 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:22.249877 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-7fe93c88-f6e7-4e98-ba5b-09f26ac287f0 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:22.406075 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-7fe93c88-f6e7-4e98-ba5b-09f26ac287f0 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:22.414976 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-7fe93c88-f6e7-4e98-ba5b-09f26ac287f0 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/762e880e-7ec3-41bb-aac7-fa05de4efd11" status: 200 len: 1521 microversion: 2.1 time: 0.179539 Jun 23 11:46:22.415528 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 177/324] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:46:22 2022] GET /compute/v2.1/servers/762e880e-7ec3-41bb-aac7-fa05de4efd11 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:46:22.900230 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-ea5a0918-0187-4848-894f-a2b13778b408 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:46:22.901022 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-ea5a0918-0187-4848-894f-a2b13778b408 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:46:22.907651 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ea5a0918-0187-4848-894f-a2b13778b408 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:22.908096 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ea5a0918-0187-4848-894f-a2b13778b408 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:22.908850 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ea5a0918-0187-4848-894f-a2b13778b408 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:22.909281 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ea5a0918-0187-4848-894f-a2b13778b408 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:23.049894 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-ea5a0918-0187-4848-894f-a2b13778b408 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:23.058909 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-ea5a0918-0187-4848-894f-a2b13778b408 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:23.060389 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-ea5a0918-0187-4848-894f-a2b13778b408 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:23.061475 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-ea5a0918-0187-4848-894f-a2b13778b408 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1403 microversion: 2.20 time: 0.165162 Jun 23 11:46:23.062016 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 148/325] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:46:22 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1403 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:46:23.433007 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-7f4cf641-a054-4f71-868f-854c0b989049 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:46:23.433708 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-7f4cf641-a054-4f71-868f-854c0b989049 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 762e880e-7ec3-41bb-aac7-fa05de4efd11] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:46:23.439766 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-7f4cf641-a054-4f71-868f-854c0b989049 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:23.440211 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-7f4cf641-a054-4f71-868f-854c0b989049 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:23.444627 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-7f4cf641-a054-4f71-868f-854c0b989049 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:23.444627 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-7f4cf641-a054-4f71-868f-854c0b989049 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:23.577215 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-7f4cf641-a054-4f71-868f-854c0b989049 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:23.586189 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-7f4cf641-a054-4f71-868f-854c0b989049 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/762e880e-7ec3-41bb-aac7-fa05de4efd11" status: 200 len: 1521 microversion: 2.1 time: 0.157686 Jun 23 11:46:23.586796 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 178/326] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:46:23 2022] GET /compute/v2.1/servers/762e880e-7ec3-41bb-aac7-fa05de4efd11 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:46:24.079771 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-2b59dcd7-ac45-445d-b8d2-e4596a15bf43 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:46:24.080445 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-2b59dcd7-ac45-445d-b8d2-e4596a15bf43 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:46:24.089374 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-2b59dcd7-ac45-445d-b8d2-e4596a15bf43 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:24.089932 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-2b59dcd7-ac45-445d-b8d2-e4596a15bf43 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:24.090991 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-2b59dcd7-ac45-445d-b8d2-e4596a15bf43 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:24.091507 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-2b59dcd7-ac45-445d-b8d2-e4596a15bf43 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:24.253453 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-2b59dcd7-ac45-445d-b8d2-e4596a15bf43 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:24.263410 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-2b59dcd7-ac45-445d-b8d2-e4596a15bf43 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:24.265019 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-2b59dcd7-ac45-445d-b8d2-e4596a15bf43 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:24.266001 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-2b59dcd7-ac45-445d-b8d2-e4596a15bf43 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1403 microversion: 2.20 time: 0.190192 Jun 23 11:46:24.266738 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 149/327] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:46:24 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1403 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:46:24.602615 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [req-6284424e-38d8-4675-9b3b-6b025aacc5b0 req-7fef1b0c-19ed-4af2-84a2-a843b54912ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9e98590-5036-4ade-bbba-f743256ac961", "tag": "ff54d5bf-cdc7-493b-be07-f5ca28b2681b"}]} {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:46:24.605191 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-ed024d4b-b4bc-46c0-a9b9-18f69c508191 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:46:24.606030 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-ed024d4b-b4bc-46c0-a9b9-18f69c508191 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 762e880e-7ec3-41bb-aac7-fa05de4efd11] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:46:24.612623 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-6284424e-38d8-4675-9b3b-6b025aacc5b0 req-7fef1b0c-19ed-4af2-84a2-a843b54912ff service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:24.612838 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ed024d4b-b4bc-46c0-a9b9-18f69c508191 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:24.613291 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ed024d4b-b4bc-46c0-a9b9-18f69c508191 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:24.613704 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-6284424e-38d8-4675-9b3b-6b025aacc5b0 req-7fef1b0c-19ed-4af2-84a2-a843b54912ff service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:24.614442 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ed024d4b-b4bc-46c0-a9b9-18f69c508191 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:24.615048 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ed024d4b-b4bc-46c0-a9b9-18f69c508191 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:24.629778 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.compute.server_external_events [req-6284424e-38d8-4675-9b3b-6b025aacc5b0 req-7fef1b0c-19ed-4af2-84a2-a843b54912ff service nova] Creating event network-changed:ff54d5bf-cdc7-493b-be07-f5ca28b2681b for instance d9e98590-5036-4ade-bbba-f743256ac961 on hv-cinder-82099 Jun 23 11:46:24.635378 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [req-6284424e-38d8-4675-9b3b-6b025aacc5b0 req-7fef1b0c-19ed-4af2-84a2-a843b54912ff service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038370 Jun 23 11:46:24.635974 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 179/328] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:46:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:46:24.762061 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-ed024d4b-b4bc-46c0-a9b9-18f69c508191 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:24.775612 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-ed024d4b-b4bc-46c0-a9b9-18f69c508191 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/762e880e-7ec3-41bb-aac7-fa05de4efd11" status: 200 len: 1521 microversion: 2.1 time: 0.174394 Jun 23 11:46:24.776212 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 150/329] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:46:24 2022] GET /compute/v2.1/servers/762e880e-7ec3-41bb-aac7-fa05de4efd11 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:46:25.280884 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_cell0:SELECT=2 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:46:25.281643 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_cell0:SELECT=14 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:46:25.285756 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-a6ae371d-44bc-484f-8d00-61cfae6403b3 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:46:25.286737 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-a6ae371d-44bc-484f-8d00-61cfae6403b3 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:46:25.292819 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a6ae371d-44bc-484f-8d00-61cfae6403b3 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:25.293262 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a6ae371d-44bc-484f-8d00-61cfae6403b3 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:25.294012 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a6ae371d-44bc-484f-8d00-61cfae6403b3 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:25.294441 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a6ae371d-44bc-484f-8d00-61cfae6403b3 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:25.502915 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-a6ae371d-44bc-484f-8d00-61cfae6403b3 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:25.512015 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-a6ae371d-44bc-484f-8d00-61cfae6403b3 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:25.513556 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-a6ae371d-44bc-484f-8d00-61cfae6403b3 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:25.514697 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-a6ae371d-44bc-484f-8d00-61cfae6403b3 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1403 microversion: 2.20 time: 0.234713 Jun 23 11:46:25.515255 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 180/330] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:46:25 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1403 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:46:25.800588 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-e7c643ad-fd43-4b23-898c-b083976d0973 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:46:25.801126 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-e7c643ad-fd43-4b23-898c-b083976d0973 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 762e880e-7ec3-41bb-aac7-fa05de4efd11] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:46:25.808252 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-e7c643ad-fd43-4b23-898c-b083976d0973 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:25.808703 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-e7c643ad-fd43-4b23-898c-b083976d0973 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:25.809462 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-e7c643ad-fd43-4b23-898c-b083976d0973 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:25.809908 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-e7c643ad-fd43-4b23-898c-b083976d0973 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:25.938266 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-e7c643ad-fd43-4b23-898c-b083976d0973 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:25.947802 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-e7c643ad-fd43-4b23-898c-b083976d0973 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/762e880e-7ec3-41bb-aac7-fa05de4efd11" status: 200 len: 1521 microversion: 2.1 time: 0.151161 Jun 23 11:46:25.948357 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 151/331] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:46:25 2022] GET /compute/v2.1/servers/762e880e-7ec3-41bb-aac7-fa05de4efd11 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:46:26.540403 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-9acafe54-fad8-44d1-b4a7-3c250db4d129 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:46:26.540999 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-9acafe54-fad8-44d1-b4a7-3c250db4d129 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:46:26.547339 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-9acafe54-fad8-44d1-b4a7-3c250db4d129 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:26.547830 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-9acafe54-fad8-44d1-b4a7-3c250db4d129 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:26.548588 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-9acafe54-fad8-44d1-b4a7-3c250db4d129 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:26.549021 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-9acafe54-fad8-44d1-b4a7-3c250db4d129 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:26.684169 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-9acafe54-fad8-44d1-b4a7-3c250db4d129 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:26.692171 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-9acafe54-fad8-44d1-b4a7-3c250db4d129 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:26.693664 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-9acafe54-fad8-44d1-b4a7-3c250db4d129 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:26.694796 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-9acafe54-fad8-44d1-b4a7-3c250db4d129 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1403 microversion: 2.20 time: 0.159308 Jun 23 11:46:26.695332 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 181/332] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:46:26 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1403 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:46:26.965521 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-fb20806e-a934-47c1-840b-9e2ea8ed6cf0 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:46:26.966523 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-fb20806e-a934-47c1-840b-9e2ea8ed6cf0 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 762e880e-7ec3-41bb-aac7-fa05de4efd11] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:46:26.968400 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_cell0:SELECT=4 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:46:26.974366 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-fb20806e-a934-47c1-840b-9e2ea8ed6cf0 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:26.974855 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-fb20806e-a934-47c1-840b-9e2ea8ed6cf0 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:26.975628 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-fb20806e-a934-47c1-840b-9e2ea8ed6cf0 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:26.976064 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-fb20806e-a934-47c1-840b-9e2ea8ed6cf0 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:27.111756 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-fb20806e-a934-47c1-840b-9e2ea8ed6cf0 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:27.119943 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-fb20806e-a934-47c1-840b-9e2ea8ed6cf0 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/762e880e-7ec3-41bb-aac7-fa05de4efd11" status: 200 len: 1521 microversion: 2.1 time: 0.158282 Jun 23 11:46:27.122508 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 152/333] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:46:26 2022] GET /compute/v2.1/servers/762e880e-7ec3-41bb-aac7-fa05de4efd11 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:46:27.713597 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-8ac91b2d-657e-4e09-b25e-86c0b6b03c92 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:46:27.714193 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-8ac91b2d-657e-4e09-b25e-86c0b6b03c92 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:46:27.720187 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-8ac91b2d-657e-4e09-b25e-86c0b6b03c92 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:27.720632 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-8ac91b2d-657e-4e09-b25e-86c0b6b03c92 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:27.721377 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-8ac91b2d-657e-4e09-b25e-86c0b6b03c92 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:27.721801 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-8ac91b2d-657e-4e09-b25e-86c0b6b03c92 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:27.854637 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-8ac91b2d-657e-4e09-b25e-86c0b6b03c92 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:27.862561 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-8ac91b2d-657e-4e09-b25e-86c0b6b03c92 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:27.864700 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-8ac91b2d-657e-4e09-b25e-86c0b6b03c92 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:27.866397 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-8ac91b2d-657e-4e09-b25e-86c0b6b03c92 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1403 microversion: 2.20 time: 0.156763 Jun 23 11:46:27.866977 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 182/334] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:46:27 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1403 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:46:28.136108 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-5ec92f7d-4d01-4c27-bc67-78b9b89684e8 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:46:28.136714 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-5ec92f7d-4d01-4c27-bc67-78b9b89684e8 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 762e880e-7ec3-41bb-aac7-fa05de4efd11] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:46:28.143181 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-5ec92f7d-4d01-4c27-bc67-78b9b89684e8 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:28.143639 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-5ec92f7d-4d01-4c27-bc67-78b9b89684e8 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:28.144393 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-5ec92f7d-4d01-4c27-bc67-78b9b89684e8 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:28.144828 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-5ec92f7d-4d01-4c27-bc67-78b9b89684e8 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:28.275703 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-5ec92f7d-4d01-4c27-bc67-78b9b89684e8 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:28.283442 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-5ec92f7d-4d01-4c27-bc67-78b9b89684e8 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/762e880e-7ec3-41bb-aac7-fa05de4efd11" status: 200 len: 1521 microversion: 2.1 time: 0.151058 Jun 23 11:46:28.284327 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 153/335] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:46:28 2022] GET /compute/v2.1/servers/762e880e-7ec3-41bb-aac7-fa05de4efd11 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:46:28.884388 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-68980cc6-4043-4f63-99d5-a41027a0cf67 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:46:28.884991 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-68980cc6-4043-4f63-99d5-a41027a0cf67 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:46:28.891004 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-68980cc6-4043-4f63-99d5-a41027a0cf67 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:28.891446 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-68980cc6-4043-4f63-99d5-a41027a0cf67 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:28.892186 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-68980cc6-4043-4f63-99d5-a41027a0cf67 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:28.892609 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-68980cc6-4043-4f63-99d5-a41027a0cf67 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:29.020512 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-68980cc6-4043-4f63-99d5-a41027a0cf67 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:29.028907 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-68980cc6-4043-4f63-99d5-a41027a0cf67 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:29.030423 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-68980cc6-4043-4f63-99d5-a41027a0cf67 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:29.031555 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-68980cc6-4043-4f63-99d5-a41027a0cf67 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1403 microversion: 2.20 time: 0.151787 Jun 23 11:46:29.032098 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 183/336] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:46:28 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1403 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:46:29.300951 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-b4d1fac7-4fec-49a4-bc47-63718adde92b tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:46:29.301561 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-b4d1fac7-4fec-49a4-bc47-63718adde92b tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 762e880e-7ec3-41bb-aac7-fa05de4efd11] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:46:29.308782 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-b4d1fac7-4fec-49a4-bc47-63718adde92b tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:29.309232 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-b4d1fac7-4fec-49a4-bc47-63718adde92b tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:29.309985 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-b4d1fac7-4fec-49a4-bc47-63718adde92b tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:29.310430 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-b4d1fac7-4fec-49a4-bc47-63718adde92b tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:29.436980 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-b4d1fac7-4fec-49a4-bc47-63718adde92b tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:29.444616 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-b4d1fac7-4fec-49a4-bc47-63718adde92b tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/762e880e-7ec3-41bb-aac7-fa05de4efd11" status: 200 len: 1521 microversion: 2.1 time: 0.147491 Jun 23 11:46:29.445176 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 154/337] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:46:29 2022] GET /compute/v2.1/servers/762e880e-7ec3-41bb-aac7-fa05de4efd11 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:46:30.049225 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-2fdf6132-4226-41a2-bf04-92afbc871a80 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:46:30.050033 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-2fdf6132-4226-41a2-bf04-92afbc871a80 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:46:30.056404 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-2fdf6132-4226-41a2-bf04-92afbc871a80 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:30.056851 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-2fdf6132-4226-41a2-bf04-92afbc871a80 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:30.057608 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-2fdf6132-4226-41a2-bf04-92afbc871a80 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:30.058041 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-2fdf6132-4226-41a2-bf04-92afbc871a80 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:30.191316 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-2fdf6132-4226-41a2-bf04-92afbc871a80 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:30.199753 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-2fdf6132-4226-41a2-bf04-92afbc871a80 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:30.201528 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-2fdf6132-4226-41a2-bf04-92afbc871a80 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:30.202764 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-2fdf6132-4226-41a2-bf04-92afbc871a80 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1403 microversion: 2.20 time: 0.157288 Jun 23 11:46:30.203316 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 184/338] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:46:30 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1403 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:46:30.461852 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-c5e438d3-48b0-43c5-adb0-90d98baa0105 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:46:30.462455 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-c5e438d3-48b0-43c5-adb0-90d98baa0105 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 762e880e-7ec3-41bb-aac7-fa05de4efd11] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:46:30.469157 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c5e438d3-48b0-43c5-adb0-90d98baa0105 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:30.469600 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c5e438d3-48b0-43c5-adb0-90d98baa0105 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:30.470344 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c5e438d3-48b0-43c5-adb0-90d98baa0105 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:30.470794 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c5e438d3-48b0-43c5-adb0-90d98baa0105 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:30.601178 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-c5e438d3-48b0-43c5-adb0-90d98baa0105 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:30.608563 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-c5e438d3-48b0-43c5-adb0-90d98baa0105 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/762e880e-7ec3-41bb-aac7-fa05de4efd11" status: 200 len: 1521 microversion: 2.1 time: 0.151111 Jun 23 11:46:30.609119 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 155/339] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:46:30 2022] GET /compute/v2.1/servers/762e880e-7ec3-41bb-aac7-fa05de4efd11 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:46:31.221337 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-25904174-c065-4081-8407-9d088f83ee51 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:46:31.221937 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-25904174-c065-4081-8407-9d088f83ee51 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:46:31.224889 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=5 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:46:31.229536 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-25904174-c065-4081-8407-9d088f83ee51 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:31.229979 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-25904174-c065-4081-8407-9d088f83ee51 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:31.230763 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-25904174-c065-4081-8407-9d088f83ee51 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:31.231232 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-25904174-c065-4081-8407-9d088f83ee51 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:31.363383 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-25904174-c065-4081-8407-9d088f83ee51 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:31.371539 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-25904174-c065-4081-8407-9d088f83ee51 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:31.373049 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-25904174-c065-4081-8407-9d088f83ee51 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:31.374159 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-25904174-c065-4081-8407-9d088f83ee51 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1403 microversion: 2.20 time: 0.156665 Jun 23 11:46:31.374727 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 185/340] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:46:31 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1403 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:46:31.625811 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-c2a18254-c562-4336-a9be-7c74e43d5d05 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:46:31.626487 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-c2a18254-c562-4336-a9be-7c74e43d5d05 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 762e880e-7ec3-41bb-aac7-fa05de4efd11] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:46:31.633687 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c2a18254-c562-4336-a9be-7c74e43d5d05 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:31.634132 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c2a18254-c562-4336-a9be-7c74e43d5d05 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:31.634916 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c2a18254-c562-4336-a9be-7c74e43d5d05 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:31.635353 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c2a18254-c562-4336-a9be-7c74e43d5d05 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:31.767629 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-c2a18254-c562-4336-a9be-7c74e43d5d05 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:31.775753 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-c2a18254-c562-4336-a9be-7c74e43d5d05 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/762e880e-7ec3-41bb-aac7-fa05de4efd11" status: 200 len: 1521 microversion: 2.1 time: 0.153821 Jun 23 11:46:31.776583 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 156/341] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:46:31 2022] GET /compute/v2.1/servers/762e880e-7ec3-41bb-aac7-fa05de4efd11 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:46:32.397109 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-61dbf472-cb9e-4453-8dc8-2d85b6d7b092 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:46:32.397723 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-61dbf472-cb9e-4453-8dc8-2d85b6d7b092 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:46:32.403996 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-61dbf472-cb9e-4453-8dc8-2d85b6d7b092 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:32.404571 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-61dbf472-cb9e-4453-8dc8-2d85b6d7b092 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:32.405355 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-61dbf472-cb9e-4453-8dc8-2d85b6d7b092 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:32.405925 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-61dbf472-cb9e-4453-8dc8-2d85b6d7b092 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:32.534919 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-61dbf472-cb9e-4453-8dc8-2d85b6d7b092 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:32.543660 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-61dbf472-cb9e-4453-8dc8-2d85b6d7b092 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:32.545183 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-61dbf472-cb9e-4453-8dc8-2d85b6d7b092 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:32.546275 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-61dbf472-cb9e-4453-8dc8-2d85b6d7b092 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1403 microversion: 2.20 time: 0.153203 Jun 23 11:46:32.546877 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 186/342] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:46:32 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1403 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:46:32.793568 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-9e271329-fa4d-4d96-8d12-3b316a20fc5a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:46:32.794176 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-9e271329-fa4d-4d96-8d12-3b316a20fc5a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 762e880e-7ec3-41bb-aac7-fa05de4efd11] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:46:32.800706 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-9e271329-fa4d-4d96-8d12-3b316a20fc5a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:32.801151 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-9e271329-fa4d-4d96-8d12-3b316a20fc5a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:32.801905 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-9e271329-fa4d-4d96-8d12-3b316a20fc5a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:32.802942 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-9e271329-fa4d-4d96-8d12-3b316a20fc5a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:32.933969 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-9e271329-fa4d-4d96-8d12-3b316a20fc5a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:32.941770 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-9e271329-fa4d-4d96-8d12-3b316a20fc5a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/762e880e-7ec3-41bb-aac7-fa05de4efd11" status: 200 len: 1521 microversion: 2.1 time: 0.151936 Jun 23 11:46:32.942326 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 157/343] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:46:32 2022] GET /compute/v2.1/servers/762e880e-7ec3-41bb-aac7-fa05de4efd11 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:46:33.563856 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-4c5a44c9-0df6-4c3a-9bf9-50060b699d79 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:46:33.564458 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-4c5a44c9-0df6-4c3a-9bf9-50060b699d79 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:46:33.571412 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-4c5a44c9-0df6-4c3a-9bf9-50060b699d79 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:33.571834 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-4c5a44c9-0df6-4c3a-9bf9-50060b699d79 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:33.572574 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-4c5a44c9-0df6-4c3a-9bf9-50060b699d79 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:33.573001 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-4c5a44c9-0df6-4c3a-9bf9-50060b699d79 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:33.575540 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_cell1:SELECT=100 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:46:33.704601 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-4c5a44c9-0df6-4c3a-9bf9-50060b699d79 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:33.713609 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-4c5a44c9-0df6-4c3a-9bf9-50060b699d79 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:33.715159 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-4c5a44c9-0df6-4c3a-9bf9-50060b699d79 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:33.716300 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-4c5a44c9-0df6-4c3a-9bf9-50060b699d79 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1403 microversion: 2.20 time: 0.156356 Jun 23 11:46:33.716850 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 187/344] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:46:33 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1403 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:46:33.958793 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-68373891-7a95-4a3f-903a-47238a12d4e6 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:46:33.959697 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-68373891-7a95-4a3f-903a-47238a12d4e6 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 762e880e-7ec3-41bb-aac7-fa05de4efd11] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:46:33.966135 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-68373891-7a95-4a3f-903a-47238a12d4e6 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:33.966616 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-68373891-7a95-4a3f-903a-47238a12d4e6 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:33.967373 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-68373891-7a95-4a3f-903a-47238a12d4e6 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:33.967800 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-68373891-7a95-4a3f-903a-47238a12d4e6 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:34.100801 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-68373891-7a95-4a3f-903a-47238a12d4e6 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:34.108348 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-68373891-7a95-4a3f-903a-47238a12d4e6 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/762e880e-7ec3-41bb-aac7-fa05de4efd11" status: 200 len: 1521 microversion: 2.1 time: 0.153409 Jun 23 11:46:34.108903 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 158/345] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:46:33 2022] GET /compute/v2.1/servers/762e880e-7ec3-41bb-aac7-fa05de4efd11 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:46:34.734409 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-5f5a47a4-49d2-44b4-a794-c41c7e3c18f0 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:46:34.735060 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-5f5a47a4-49d2-44b4-a794-c41c7e3c18f0 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:46:34.742058 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-5f5a47a4-49d2-44b4-a794-c41c7e3c18f0 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:34.742504 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-5f5a47a4-49d2-44b4-a794-c41c7e3c18f0 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:34.743275 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-5f5a47a4-49d2-44b4-a794-c41c7e3c18f0 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:34.743704 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-5f5a47a4-49d2-44b4-a794-c41c7e3c18f0 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:34.877114 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-5f5a47a4-49d2-44b4-a794-c41c7e3c18f0 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:34.888599 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-5f5a47a4-49d2-44b4-a794-c41c7e3c18f0 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:34.890044 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-5f5a47a4-49d2-44b4-a794-c41c7e3c18f0 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:34.891177 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-5f5a47a4-49d2-44b4-a794-c41c7e3c18f0 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1403 microversion: 2.20 time: 0.160650 Jun 23 11:46:34.891725 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 188/346] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:46:34 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1403 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:46:35.125240 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-88e8900d-edf6-4015-9459-ec74a7e0245a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:46:35.125927 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-88e8900d-edf6-4015-9459-ec74a7e0245a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 762e880e-7ec3-41bb-aac7-fa05de4efd11] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:46:35.133348 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_api:SELECT=52 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:46:35.133938 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-88e8900d-edf6-4015-9459-ec74a7e0245a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:35.134390 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-88e8900d-edf6-4015-9459-ec74a7e0245a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:35.135192 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-88e8900d-edf6-4015-9459-ec74a7e0245a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:35.135629 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-88e8900d-edf6-4015-9459-ec74a7e0245a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:35.264634 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-88e8900d-edf6-4015-9459-ec74a7e0245a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:35.272118 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-88e8900d-edf6-4015-9459-ec74a7e0245a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/762e880e-7ec3-41bb-aac7-fa05de4efd11" status: 200 len: 1521 microversion: 2.1 time: 0.150769 Jun 23 11:46:35.272693 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 159/347] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:46:35 2022] GET /compute/v2.1/servers/762e880e-7ec3-41bb-aac7-fa05de4efd11 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:46:35.908349 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-aeac19aa-86fe-44fe-bacf-2bdf444fb0c4 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:46:35.908958 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-aeac19aa-86fe-44fe-bacf-2bdf444fb0c4 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:46:35.915560 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-aeac19aa-86fe-44fe-bacf-2bdf444fb0c4 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:35.916007 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-aeac19aa-86fe-44fe-bacf-2bdf444fb0c4 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:35.916755 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-aeac19aa-86fe-44fe-bacf-2bdf444fb0c4 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:35.917187 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-aeac19aa-86fe-44fe-bacf-2bdf444fb0c4 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:36.064151 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-aeac19aa-86fe-44fe-bacf-2bdf444fb0c4 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:36.072762 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-aeac19aa-86fe-44fe-bacf-2bdf444fb0c4 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:36.074304 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-aeac19aa-86fe-44fe-bacf-2bdf444fb0c4 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:36.075440 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-aeac19aa-86fe-44fe-bacf-2bdf444fb0c4 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1403 microversion: 2.20 time: 0.170991 Jun 23 11:46:36.075998 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 189/348] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:46:35 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1403 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:46:36.288578 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-6660247e-918f-4497-af85-e5a61f476a31 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:46:36.289129 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-6660247e-918f-4497-af85-e5a61f476a31 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 762e880e-7ec3-41bb-aac7-fa05de4efd11] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:46:36.295589 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-6660247e-918f-4497-af85-e5a61f476a31 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:36.296039 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-6660247e-918f-4497-af85-e5a61f476a31 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:36.296889 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-6660247e-918f-4497-af85-e5a61f476a31 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:36.297318 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-6660247e-918f-4497-af85-e5a61f476a31 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:36.313466 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_cell1:SELECT=100 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:46:36.426631 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-6660247e-918f-4497-af85-e5a61f476a31 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:36.434644 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-6660247e-918f-4497-af85-e5a61f476a31 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/762e880e-7ec3-41bb-aac7-fa05de4efd11" status: 200 len: 1521 microversion: 2.1 time: 0.150046 Jun 23 11:46:36.435208 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 160/349] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:46:36 2022] GET /compute/v2.1/servers/762e880e-7ec3-41bb-aac7-fa05de4efd11 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:46:37.094158 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-a2711199-449b-4d2f-9ba0-256fbb8e53ce tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:46:37.095073 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-a2711199-449b-4d2f-9ba0-256fbb8e53ce tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:46:37.102854 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a2711199-449b-4d2f-9ba0-256fbb8e53ce tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:37.103375 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a2711199-449b-4d2f-9ba0-256fbb8e53ce tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:37.104136 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a2711199-449b-4d2f-9ba0-256fbb8e53ce tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:37.104578 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a2711199-449b-4d2f-9ba0-256fbb8e53ce tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:37.175493 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [req-09baede9-313c-4468-b4b2-4c3c3865e25f req-7cc5db60-90cb-4445-ae96-1e71c98ef00b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9e98590-5036-4ade-bbba-f743256ac961", "name": "network-vif-plugged", "status": "completed", "tag": "ff54d5bf-cdc7-493b-be07-f5ca28b2681b"}]} {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:46:37.184497 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [req-09baede9-313c-4468-b4b2-4c3c3865e25f req-7cc5db60-90cb-4445-ae96-1e71c98ef00b service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:37.185120 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [req-09baede9-313c-4468-b4b2-4c3c3865e25f req-7cc5db60-90cb-4445-ae96-1e71c98ef00b service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:37.196506 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.compute.server_external_events [req-09baede9-313c-4468-b4b2-4c3c3865e25f req-7cc5db60-90cb-4445-ae96-1e71c98ef00b service nova] Creating event network-vif-plugged:ff54d5bf-cdc7-493b-be07-f5ca28b2681b for instance d9e98590-5036-4ade-bbba-f743256ac961 on hv-cinder-82099 Jun 23 11:46:37.201822 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [req-09baede9-313c-4468-b4b2-4c3c3865e25f req-7cc5db60-90cb-4445-ae96-1e71c98ef00b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030269 Jun 23 11:46:37.202408 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 161/350] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:46:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:46:37.243865 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-a2711199-449b-4d2f-9ba0-256fbb8e53ce tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:37.246796 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-a2711199-449b-4d2f-9ba0-256fbb8e53ce tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:37.248306 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-a2711199-449b-4d2f-9ba0-256fbb8e53ce tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:37.249622 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-a2711199-449b-4d2f-9ba0-256fbb8e53ce tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1403 microversion: 2.20 time: 0.160195 Jun 23 11:46:37.250239 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 190/351] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:46:37 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1403 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:46:37.454254 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-05ce250d-2652-460d-8530-ede63b504f1e tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:46:37.454997 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-05ce250d-2652-460d-8530-ede63b504f1e tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 762e880e-7ec3-41bb-aac7-fa05de4efd11] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:46:37.462763 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-05ce250d-2652-460d-8530-ede63b504f1e tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:37.463913 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-05ce250d-2652-460d-8530-ede63b504f1e tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:37.464035 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-05ce250d-2652-460d-8530-ede63b504f1e tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:37.464445 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-05ce250d-2652-460d-8530-ede63b504f1e tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:37.608417 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-05ce250d-2652-460d-8530-ede63b504f1e tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:37.616539 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-05ce250d-2652-460d-8530-ede63b504f1e tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/762e880e-7ec3-41bb-aac7-fa05de4efd11" status: 200 len: 1521 microversion: 2.1 time: 0.167410 Jun 23 11:46:37.617181 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 162/352] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:46:37 2022] GET /compute/v2.1/servers/762e880e-7ec3-41bb-aac7-fa05de4efd11 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:46:38.268082 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-d422e958-064b-4284-bc3d-591b03a9542e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:46:38.268803 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-d422e958-064b-4284-bc3d-591b03a9542e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:46:38.275545 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-d422e958-064b-4284-bc3d-591b03a9542e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:38.275992 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-d422e958-064b-4284-bc3d-591b03a9542e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:38.276746 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-d422e958-064b-4284-bc3d-591b03a9542e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:38.277177 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-d422e958-064b-4284-bc3d-591b03a9542e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:38.403516 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-d422e958-064b-4284-bc3d-591b03a9542e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:38.411457 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-d422e958-064b-4284-bc3d-591b03a9542e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:38.412968 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-d422e958-064b-4284-bc3d-591b03a9542e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:38.414600 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-d422e958-064b-4284-bc3d-591b03a9542e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1403 microversion: 2.20 time: 0.150141 Jun 23 11:46:38.414938 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 191/353] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:46:38 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1403 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:46:38.633224 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-3e82b8b3-08b2-4446-b62f-bd2d1af8773a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:46:38.634376 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-3e82b8b3-08b2-4446-b62f-bd2d1af8773a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 762e880e-7ec3-41bb-aac7-fa05de4efd11] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:46:38.640968 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-3e82b8b3-08b2-4446-b62f-bd2d1af8773a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:38.641409 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-3e82b8b3-08b2-4446-b62f-bd2d1af8773a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:38.642155 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-3e82b8b3-08b2-4446-b62f-bd2d1af8773a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:38.642606 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-3e82b8b3-08b2-4446-b62f-bd2d1af8773a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:38.780807 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-3e82b8b3-08b2-4446-b62f-bd2d1af8773a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:38.788330 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-3e82b8b3-08b2-4446-b62f-bd2d1af8773a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/762e880e-7ec3-41bb-aac7-fa05de4efd11" status: 200 len: 1521 microversion: 2.1 time: 0.159065 Jun 23 11:46:38.788889 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 163/354] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:46:38 2022] GET /compute/v2.1/servers/762e880e-7ec3-41bb-aac7-fa05de4efd11 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:46:39.432709 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-f6a2bb85-b112-4797-97e7-a66a31ba04f6 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:46:39.433833 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-f6a2bb85-b112-4797-97e7-a66a31ba04f6 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:46:39.440108 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-f6a2bb85-b112-4797-97e7-a66a31ba04f6 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:39.446341 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-f6a2bb85-b112-4797-97e7-a66a31ba04f6 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:39.446341 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-f6a2bb85-b112-4797-97e7-a66a31ba04f6 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:39.446341 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-f6a2bb85-b112-4797-97e7-a66a31ba04f6 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:39.570278 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-f6a2bb85-b112-4797-97e7-a66a31ba04f6 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:39.581327 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-f6a2bb85-b112-4797-97e7-a66a31ba04f6 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:39.582913 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-f6a2bb85-b112-4797-97e7-a66a31ba04f6 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:39.584512 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-f6a2bb85-b112-4797-97e7-a66a31ba04f6 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1403 microversion: 2.20 time: 0.155828 Jun 23 11:46:39.585058 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 192/355] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:46:39 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1403 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:46:39.805321 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-94efdb1a-f6ec-430d-a6ca-f165685089c8 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:46:39.805965 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-94efdb1a-f6ec-430d-a6ca-f165685089c8 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 762e880e-7ec3-41bb-aac7-fa05de4efd11] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:46:39.821529 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-94efdb1a-f6ec-430d-a6ca-f165685089c8 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:39.821529 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-94efdb1a-f6ec-430d-a6ca-f165685089c8 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:39.821529 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-94efdb1a-f6ec-430d-a6ca-f165685089c8 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:39.821529 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-94efdb1a-f6ec-430d-a6ca-f165685089c8 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:39.958729 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-94efdb1a-f6ec-430d-a6ca-f165685089c8 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:39.968606 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-94efdb1a-f6ec-430d-a6ca-f165685089c8 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/762e880e-7ec3-41bb-aac7-fa05de4efd11" status: 200 len: 1521 microversion: 2.1 time: 0.166894 Jun 23 11:46:39.969446 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 164/356] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:46:39 2022] GET /compute/v2.1/servers/762e880e-7ec3-41bb-aac7-fa05de4efd11 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:46:40.604279 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-de94e5bf-d9d2-4cc1-8a01-2c7949a787ef tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:46:40.604919 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-de94e5bf-d9d2-4cc1-8a01-2c7949a787ef tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:46:40.611677 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-de94e5bf-d9d2-4cc1-8a01-2c7949a787ef tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:40.612133 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-de94e5bf-d9d2-4cc1-8a01-2c7949a787ef tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:40.612903 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-de94e5bf-d9d2-4cc1-8a01-2c7949a787ef tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:40.613345 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-de94e5bf-d9d2-4cc1-8a01-2c7949a787ef tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:40.754781 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-de94e5bf-d9d2-4cc1-8a01-2c7949a787ef tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:40.763048 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-de94e5bf-d9d2-4cc1-8a01-2c7949a787ef tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:40.764812 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-de94e5bf-d9d2-4cc1-8a01-2c7949a787ef tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:40.766060 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-de94e5bf-d9d2-4cc1-8a01-2c7949a787ef tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1595 microversion: 2.20 time: 0.166921 Jun 23 11:46:40.766623 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 193/357] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:46:40 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1595 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:46:40.784048 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-ecc1ef99-5559-4c4b-b935-057de0affbeb tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:46:40.784579 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-ecc1ef99-5559-4c4b-b935-057de0affbeb tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:46:40.791483 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ecc1ef99-5559-4c4b-b935-057de0affbeb tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:40.791938 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ecc1ef99-5559-4c4b-b935-057de0affbeb tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:40.792866 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ecc1ef99-5559-4c4b-b935-057de0affbeb tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:40.793292 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ecc1ef99-5559-4c4b-b935-057de0affbeb tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:40.872072 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-ecc1ef99-5559-4c4b-b935-057de0affbeb tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.091970 Jun 23 11:46:40.872652 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 165/358] 10.222.0.13 () {60 vars in 1315 bytes} [Thu Jun 23 11:46:40 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 11:46:40.990374 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-2351c5af-767a-464d-89b7-e7dc3eda1631 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:46:40.990374 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-2351c5af-767a-464d-89b7-e7dc3eda1631 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 762e880e-7ec3-41bb-aac7-fa05de4efd11] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:46:40.996060 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-2351c5af-767a-464d-89b7-e7dc3eda1631 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:40.996734 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-2351c5af-767a-464d-89b7-e7dc3eda1631 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:40.997499 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-2351c5af-767a-464d-89b7-e7dc3eda1631 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:40.997928 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-2351c5af-767a-464d-89b7-e7dc3eda1631 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:41.269631 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-2351c5af-767a-464d-89b7-e7dc3eda1631 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:41.277952 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-2351c5af-767a-464d-89b7-e7dc3eda1631 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/762e880e-7ec3-41bb-aac7-fa05de4efd11" status: 200 len: 1501 microversion: 2.1 time: 0.293244 Jun 23 11:46:41.278515 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 194/359] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:46:40 2022] GET /compute/v2.1/servers/762e880e-7ec3-41bb-aac7-fa05de4efd11 => generated 1501 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:46:41.299745 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-3addc395-d505-4425-8006-3c82790da2f1 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b2a33224-8d79-4eca-add3-0bef7d2ace6d"}} {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:46:41.303010 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-3addc395-d505-4425-8006-3c82790da2f1 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 762e880e-7ec3-41bb-aac7-fa05de4efd11] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:46:41.309213 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-3addc395-d505-4425-8006-3c82790da2f1 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:41.309665 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-3addc395-d505-4425-8006-3c82790da2f1 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:41.310435 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-3addc395-d505-4425-8006-3c82790da2f1 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:41.310904 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-3addc395-d505-4425-8006-3c82790da2f1 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:41.334804 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.wsgi [None req-3addc395-d505-4425-8006-3c82790da2f1 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] HTTP exception thrown: Cannot 'attach_volume' instance 762e880e-7ec3-41bb-aac7-fa05de4efd11 while it is in vm_state rescued Jun 23 11:46:41.337417 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-3addc395-d505-4425-8006-3c82790da2f1 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Request method failure captured: Jun 23 11:46:41.337417 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: request: POST /compute/v2.1/servers/762e880e-7ec3-41bb-aac7-fa05de4efd11/os-volume_attachments HTTP/1.1 Jun 23 11:46:41.337417 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Accept: application/json Jun 23 11:46:41.337417 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Accept-Encoding: identity Jun 23 11:46:41.337417 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Connection: close Jun 23 11:46:41.337417 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Content-Length: 74 Jun 23 11:46:41.337417 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Content-Type: application/json Jun 23 11:46:41.337417 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Host: 10.222.0.13 Jun 23 11:46:41.337417 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Openstack-System-Scope: None Jun 23 11:46:41.337417 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: User-Agent: python-urllib3/1.26.9 Jun 23 11:46:41.337417 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Auth-Token: gAAAAABitFIQMZzIonjUbfDwf8XrsOwiJZRU6mFcRB1-tnfeb_v3NOEweS__m4o1J8UHtu-_xrjURmrJ6fzG89APjTfsnyiQVFAZpTd13GqegTFfQ58YDG0ZJ0-BfSv3ftKHTlhdH_kG2HiseMXvNGBpCdtSjep9DwmxqUcu34-5A9JBS3aKDXY Jun 23 11:46:41.337417 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Domain-Id: None Jun 23 11:46:41.337417 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Domain-Name: None Jun 23 11:46:41.337417 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Identity-Status: Confirmed Jun 23 11:46:41.337417 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Is-Admin-Project: True Jun 23 11:46:41.337417 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Domain-Id: default Jun 23 11:46:41.337417 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Domain-Name: Default Jun 23 11:46:41.337417 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Id: b6241924efa944a68503a87b695c7410 Jun 23 11:46:41.337417 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-493570352 Jun 23 11:46:41.337417 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Role: member,reader Jun 23 11:46:41.337417 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Roles: member,reader Jun 23 11:46:41.339007 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b6241924efa944a68503a87b695c7410"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b6241924efa944a68503a87b695c7410"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b6241924efa944a68503a87b695c7410"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b6241924efa944a68503a87b695c7410"}]}] Jun 23 11:46:41.339007 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant: tempest-ServerRescueNegativeTestJSON-493570352 Jun 23 11:46:41.339007 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant-Id: b6241924efa944a68503a87b695c7410 Jun 23 11:46:41.339007 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-493570352 Jun 23 11:46:41.339007 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User: tempest-ServerRescueNegativeTestJSON-493570352-project Jun 23 11:46:41.339007 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Domain-Id: default Jun 23 11:46:41.339007 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Domain-Name: Default Jun 23 11:46:41.339007 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Id: bcd5fc6167654972868941ed28c327b6 Jun 23 11:46:41.339007 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Name: tempest-ServerRescueNegativeTestJSON-493570352-project Jun 23 11:46:41.339007 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Jun 23 11:46:41.339007 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: {"volumeAttachment": {"volumeId": "b2a33224-8d79-4eca-add3-0bef7d2ace6d"}} Jun 23 11:46:41.339007 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: method: > Jun 23 11:46:41.339925 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: exception: Cannot 'attach_volume' instance 762e880e-7ec3-41bb-aac7-fa05de4efd11 while it is in vm_state rescued Jun 23 11:46:41.339925 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: action_args: {'server_id': '762e880e-7ec3-41bb-aac7-fa05de4efd11', 'body': {'volumeAttachment': {'volumeId': 'b2a33224-8d79-4eca-add3-0bef7d2ace6d'}}} Jun 23 11:46:41.339925 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:46:41.339925 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:46:41.339925 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 23 11:46:41.339925 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 23 11:46:41.339925 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 23 11:46:41.339925 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 23 11:46:41.339925 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 23 11:46:41.339925 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 23 11:46:41.339925 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 762e880e-7ec3-41bb-aac7-fa05de4efd11 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 23 11:46:41.339925 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:46:41.339925 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:46:41.339925 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:46:41.339925 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:46:41.339925 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:46:41.339925 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:46:41.339925 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:46:41.339925 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:46:41.341371 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:46:41.341371 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:46:41.341371 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 11:46:41.341371 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 11:46:41.341371 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 11:46:41.341371 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 11:46:41.341371 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 11:46:41.341371 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 11:46:41.341371 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 23 11:46:41.341371 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 23 11:46:41.341371 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 23 11:46:41.341371 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 23 11:46:41.341371 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 762e880e-7ec3-41bb-aac7-fa05de4efd11 while it is in vm_state rescued Jun 23 11:46:41.341371 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:46:41.341371 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:46:41.341371 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:46:41.341371 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:46:41.341371 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:46:41.341371 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:46:41.342746 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:46:41.342746 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:46:41.342746 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 762e880e-7ec3-41bb-aac7-fa05de4efd11 while it is in vm_state rescued Jun 23 11:46:41.342746 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:46:41.342746 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-3addc395-d505-4425-8006-3c82790da2f1 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Returning 409 to user: Cannot 'attach_volume' instance 762e880e-7ec3-41bb-aac7-fa05de4efd11 while it is in vm_state rescued {{(pid=124669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:46:41.342746 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-3addc395-d505-4425-8006-3c82790da2f1 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "POST /compute/v2.1/servers/762e880e-7ec3-41bb-aac7-fa05de4efd11/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.049904 Jun 23 11:46:41.342746 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 166/360] 10.222.0.13 () {60 vars in 1322 bytes} [Thu Jun 23 11:46:41 2022] POST /compute/v2.1/servers/762e880e-7ec3-41bb-aac7-fa05de4efd11/os-volume_attachments => generated 152 bytes in 51 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 23 11:46:41.349605 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-695d3346-b160-4262-8c79-d9118a23b12a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:46:41.350145 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-695d3346-b160-4262-8c79-d9118a23b12a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 762e880e-7ec3-41bb-aac7-fa05de4efd11] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:46:41.356654 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-695d3346-b160-4262-8c79-d9118a23b12a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:41.357104 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-695d3346-b160-4262-8c79-d9118a23b12a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:41.357909 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-695d3346-b160-4262-8c79-d9118a23b12a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:41.358346 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-695d3346-b160-4262-8c79-d9118a23b12a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:41.885704 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-695d3346-b160-4262-8c79-d9118a23b12a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "POST /compute/v2.1/servers/762e880e-7ec3-41bb-aac7-fa05de4efd11/action" status: 202 len: 0 microversion: 2.1 time: 0.539665 Jun 23 11:46:41.886961 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 195/361] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Jun 23 11:46:41 2022] POST /compute/v2.1/servers/762e880e-7ec3-41bb-aac7-fa05de4efd11/action => generated 0 bytes in 542 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 11:46:41.900926 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-2cad52f7-56f8-4e94-be55-fbb411428262 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:46:41.902279 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-2cad52f7-56f8-4e94-be55-fbb411428262 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 762e880e-7ec3-41bb-aac7-fa05de4efd11] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:46:41.922266 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-2cad52f7-56f8-4e94-be55-fbb411428262 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:41.923183 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-2cad52f7-56f8-4e94-be55-fbb411428262 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:41.927229 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-2cad52f7-56f8-4e94-be55-fbb411428262 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:41.927698 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-2cad52f7-56f8-4e94-be55-fbb411428262 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:42.360799 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-703ca8da-3fa0-4531-ae8b-f79241663866 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1850850067", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-464325998", "security_groups": [{"name": "tempest-secgroup-smoke-1004836036"}], "networks": [{"uuid": "b4bc3f09-0914-4df2-9282-7df39cfaeb79"}], "block_device_mapping_v2": [{"uuid": "b92623c1-8fa5-4422-8d30-c77702b8e11b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:46:42.391052 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-2cad52f7-56f8-4e94-be55-fbb411428262 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:42.408646 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-2cad52f7-56f8-4e94-be55-fbb411428262 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/762e880e-7ec3-41bb-aac7-fa05de4efd11" status: 200 len: 1509 microversion: 2.1 time: 0.510020 Jun 23 11:46:42.410264 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 167/362] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:46:41 2022] GET /compute/v2.1/servers/762e880e-7ec3-41bb-aac7-fa05de4efd11 => generated 1509 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:46:42.645813 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.network.neutron [None req-703ca8da-3fa0-4531-ae8b-f79241663866 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] validate_networks() for [('b4bc3f09-0914-4df2-9282-7df39cfaeb79', None, None, None, None, None)] {{(pid=124670) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 11:46:43.092632 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [req-1423c902-fadb-4755-8d7a-74d52ef8551e req-fe895793-7061-4834-97ac-e0fce4ef1db9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9e98590-5036-4ade-bbba-f743256ac961", "tag": "ff54d5bf-cdc7-493b-be07-f5ca28b2681b"}]} {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:46:43.106936 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [req-1423c902-fadb-4755-8d7a-74d52ef8551e req-fe895793-7061-4834-97ac-e0fce4ef1db9 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:43.107410 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [req-1423c902-fadb-4755-8d7a-74d52ef8551e req-fe895793-7061-4834-97ac-e0fce4ef1db9 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:43.142708 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.compute.server_external_events [req-1423c902-fadb-4755-8d7a-74d52ef8551e req-fe895793-7061-4834-97ac-e0fce4ef1db9 service nova] Creating event network-changed:ff54d5bf-cdc7-493b-be07-f5ca28b2681b for instance d9e98590-5036-4ade-bbba-f743256ac961 on hv-cinder-82099 Jun 23 11:46:43.153466 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [req-1423c902-fadb-4755-8d7a-74d52ef8551e req-fe895793-7061-4834-97ac-e0fce4ef1db9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064512 Jun 23 11:46:43.154348 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 168/363] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:46:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:46:43.362995 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.virt.hardware [None req-703ca8da-3fa0-4531-ae8b-f79241663866 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Flavor limits 0:0:0 {{(pid=124670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 11:46:43.364014 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.virt.hardware [None req-703ca8da-3fa0-4531-ae8b-f79241663866 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Image limits 0:0:0 {{(pid=124670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 11:46:43.364619 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.virt.hardware [None req-703ca8da-3fa0-4531-ae8b-f79241663866 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Flavor pref 0:0:0 {{(pid=124670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 11:46:43.365166 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.virt.hardware [None req-703ca8da-3fa0-4531-ae8b-f79241663866 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Image pref 0:0:0 {{(pid=124670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 11:46:43.365723 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.virt.hardware [None req-703ca8da-3fa0-4531-ae8b-f79241663866 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 11:46:43.376402 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-703ca8da-3fa0-4531-ae8b-f79241663866 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:43.377137 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-703ca8da-3fa0-4531-ae8b-f79241663866 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:43.378127 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-703ca8da-3fa0-4531-ae8b-f79241663866 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:43.378817 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-703ca8da-3fa0-4531-ae8b-f79241663866 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:43.397843 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.quota [None req-703ca8da-3fa0-4531-ae8b-f79241663866 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Getting quotas for project ce01d9a78d3f4bb7b101b47548b73037. Resources: {'cores', 'instances', 'ram'} {{(pid=124670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:46:43.404835 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.quota [None req-703ca8da-3fa0-4531-ae8b-f79241663866 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Getting quotas for user 626c3dbdc0f1407db82d6988e68e40b2 and project ce01d9a78d3f4bb7b101b47548b73037. Resources: {'cores', 'instances', 'ram'} {{(pid=124670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:46:43.427472 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-8f7fc3b2-236c-40e0-b191-03d661e43a2f tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:46:43.428172 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-8f7fc3b2-236c-40e0-b191-03d661e43a2f tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 762e880e-7ec3-41bb-aac7-fa05de4efd11] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:46:43.435951 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-8f7fc3b2-236c-40e0-b191-03d661e43a2f tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:43.436403 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-8f7fc3b2-236c-40e0-b191-03d661e43a2f tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:43.437178 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-8f7fc3b2-236c-40e0-b191-03d661e43a2f tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:43.437611 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-8f7fc3b2-236c-40e0-b191-03d661e43a2f tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:43.516809 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-703ca8da-3fa0-4531-ae8b-f79241663866 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Going to run 1 instances... {{(pid=124670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 11:46:43.519526 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-703ca8da-3fa0-4531-ae8b-f79241663866 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] [instance: c026366c-311a-45eb-899c-30703cd7eb1d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b92623c1-8fa5-4422-8d30-c77702b8e11b',volume_size=None,volume_type=None)] {{(pid=124670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 11:46:43.612174 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-8f7fc3b2-236c-40e0-b191-03d661e43a2f tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:43.623306 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-8f7fc3b2-236c-40e0-b191-03d661e43a2f tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/762e880e-7ec3-41bb-aac7-fa05de4efd11" status: 200 len: 1509 microversion: 2.1 time: 0.199771 Jun 23 11:46:43.624190 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 169/364] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:46:43 2022] GET /compute/v2.1/servers/762e880e-7ec3-41bb-aac7-fa05de4efd11 => generated 1509 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:46:44.003571 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-703ca8da-3fa0-4531-ae8b-f79241663866 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.647022 Jun 23 11:46:44.010512 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 196/365] 10.222.0.13 () {60 vars in 1146 bytes} [Thu Jun 23 11:46:42 2022] POST /compute/v2.1/servers => generated 406 bytes in 1655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 11:46:44.016493 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-4f7a00ec-12f7-4787-9038-a9e9d388c03e tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:46:44.017385 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-4f7a00ec-12f7-4787-9038-a9e9d388c03e tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] [instance: c026366c-311a-45eb-899c-30703cd7eb1d] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:46:44.093225 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-4f7a00ec-12f7-4787-9038-a9e9d388c03e tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626c3dbdc0f1407db82d6988e68e40b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce01d9a78d3f4bb7b101b47548b73037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:44.100627 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-4f7a00ec-12f7-4787-9038-a9e9d388c03e tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] 10.222.0.13 "GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d" status: 200 len: 1088 microversion: 2.1 time: 0.089190 Jun 23 11:46:44.102307 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 170/366] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:46:44 2022] GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d => generated 1088 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:46:44.642795 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-2051cfc2-7792-4aa4-8cbf-8800ee42ad48 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:46:44.643403 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-2051cfc2-7792-4aa4-8cbf-8800ee42ad48 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 762e880e-7ec3-41bb-aac7-fa05de4efd11] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:46:44.651393 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-2051cfc2-7792-4aa4-8cbf-8800ee42ad48 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:44.652113 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-2051cfc2-7792-4aa4-8cbf-8800ee42ad48 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:44.653094 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-2051cfc2-7792-4aa4-8cbf-8800ee42ad48 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:44.653683 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-2051cfc2-7792-4aa4-8cbf-8800ee42ad48 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:44.826338 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-2051cfc2-7792-4aa4-8cbf-8800ee42ad48 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:44.838054 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-2051cfc2-7792-4aa4-8cbf-8800ee42ad48 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/762e880e-7ec3-41bb-aac7-fa05de4efd11" status: 200 len: 1509 microversion: 2.1 time: 0.200428 Jun 23 11:46:44.838728 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 197/367] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:46:44 2022] GET /compute/v2.1/servers/762e880e-7ec3-41bb-aac7-fa05de4efd11 => generated 1509 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:46:45.126610 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-dca960bc-e9bd-4b4a-a9dc-87f34e7fa3b9 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:46:45.128256 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-dca960bc-e9bd-4b4a-a9dc-87f34e7fa3b9 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] [instance: c026366c-311a-45eb-899c-30703cd7eb1d] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:46:45.225421 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-dca960bc-e9bd-4b4a-a9dc-87f34e7fa3b9 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626c3dbdc0f1407db82d6988e68e40b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce01d9a78d3f4bb7b101b47548b73037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:45.239909 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-dca960bc-e9bd-4b4a-a9dc-87f34e7fa3b9 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] 10.222.0.13 "GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d" status: 200 len: 1088 microversion: 2.1 time: 0.123908 Jun 23 11:46:45.244463 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 171/368] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:46:45 2022] GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d => generated 1088 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:46:45.855694 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-4167034a-6f1b-4e0d-a6fb-e522a9299966 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:46:45.856302 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-4167034a-6f1b-4e0d-a6fb-e522a9299966 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 762e880e-7ec3-41bb-aac7-fa05de4efd11] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:46:45.862560 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-4167034a-6f1b-4e0d-a6fb-e522a9299966 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:45.862887 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-4167034a-6f1b-4e0d-a6fb-e522a9299966 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:45.863634 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-4167034a-6f1b-4e0d-a6fb-e522a9299966 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:45.864235 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-4167034a-6f1b-4e0d-a6fb-e522a9299966 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:46.043899 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-4167034a-6f1b-4e0d-a6fb-e522a9299966 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:46.053458 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-4167034a-6f1b-4e0d-a6fb-e522a9299966 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/762e880e-7ec3-41bb-aac7-fa05de4efd11" status: 200 len: 1515 microversion: 2.1 time: 0.202025 Jun 23 11:46:46.054032 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 198/369] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:46:45 2022] GET /compute/v2.1/servers/762e880e-7ec3-41bb-aac7-fa05de4efd11 => generated 1515 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:46:46.266135 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-455e8697-d6dc-4c3c-8c3d-3af57c9f5add tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:46:46.276108 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-455e8697-d6dc-4c3c-8c3d-3af57c9f5add tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] [instance: c026366c-311a-45eb-899c-30703cd7eb1d] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:46:46.299737 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-455e8697-d6dc-4c3c-8c3d-3af57c9f5add tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:46.300215 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-455e8697-d6dc-4c3c-8c3d-3af57c9f5add tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:46.301029 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-455e8697-d6dc-4c3c-8c3d-3af57c9f5add tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:46.303227 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-455e8697-d6dc-4c3c-8c3d-3af57c9f5add tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:46.388812 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-455e8697-d6dc-4c3c-8c3d-3af57c9f5add tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626c3dbdc0f1407db82d6988e68e40b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce01d9a78d3f4bb7b101b47548b73037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:46.400285 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-455e8697-d6dc-4c3c-8c3d-3af57c9f5add tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] 10.222.0.13 "GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d" status: 200 len: 1138 microversion: 2.1 time: 0.142295 Jun 23 11:46:46.410393 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 172/370] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:46:46 2022] GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d => generated 1138 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:46:47.421388 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-cdec6ca5-8571-4edb-9ebd-88e8afdc8dac tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:46:47.422797 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-cdec6ca5-8571-4edb-9ebd-88e8afdc8dac tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] [instance: c026366c-311a-45eb-899c-30703cd7eb1d] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:46:47.443121 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-cdec6ca5-8571-4edb-9ebd-88e8afdc8dac tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:47.447099 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-cdec6ca5-8571-4edb-9ebd-88e8afdc8dac tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:47.447099 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-cdec6ca5-8571-4edb-9ebd-88e8afdc8dac tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:47.447099 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-cdec6ca5-8571-4edb-9ebd-88e8afdc8dac tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:47.573607 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-cdec6ca5-8571-4edb-9ebd-88e8afdc8dac tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626c3dbdc0f1407db82d6988e68e40b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce01d9a78d3f4bb7b101b47548b73037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:47.592009 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-cdec6ca5-8571-4edb-9ebd-88e8afdc8dac tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] 10.222.0.13 "GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d" status: 200 len: 1186 microversion: 2.1 time: 0.176834 Jun 23 11:46:47.600354 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 199/371] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:46:47 2022] GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d => generated 1186 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:46:48.416008 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-fb783441-ff0d-4931-ac49-25fd6c418c71 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2060465935", "imageRef": "b19d6f23-214c-4432-bee6-455978023759", "flavorRef": "452", "networks": [{"uuid": "62402104-c963-4205-b4ad-5070bee7bcb3"}]}} {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:46:48.504046 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.network.neutron [None req-fb783441-ff0d-4931-ac49-25fd6c418c71 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] validate_networks() for [('62402104-c963-4205-b4ad-5070bee7bcb3', None, None, None, None, None)] {{(pid=124669) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 11:46:48.618040 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-649e2375-14f5-4429-9b94-f41d87be04c1 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:46:48.618040 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-649e2375-14f5-4429-9b94-f41d87be04c1 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] [instance: c026366c-311a-45eb-899c-30703cd7eb1d] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:46:48.626875 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-649e2375-14f5-4429-9b94-f41d87be04c1 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:48.627700 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-649e2375-14f5-4429-9b94-f41d87be04c1 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:48.629910 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-649e2375-14f5-4429-9b94-f41d87be04c1 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:48.632058 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-649e2375-14f5-4429-9b94-f41d87be04c1 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:48.818207 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-649e2375-14f5-4429-9b94-f41d87be04c1 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626c3dbdc0f1407db82d6988e68e40b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce01d9a78d3f4bb7b101b47548b73037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:48.828240 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-649e2375-14f5-4429-9b94-f41d87be04c1 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] 10.222.0.13 "GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d" status: 200 len: 1204 microversion: 2.1 time: 0.221439 Jun 23 11:46:48.828822 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 200/372] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:46:48 2022] GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d => generated 1204 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:46:49.144722 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-8a4fce74-a00c-4fba-a0f3-4bab7fa2f1c6 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Action: 'create', calling method: .version_select at 0x7f5d069c8790>, body: {"keypair": {"name": "tempest-keypair-241774240", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP4FQfi0mTqxevF6y+Gh/O3zyJAov3kUo4Ri4BtFaHUYxjIeiLC+sX278OGG8fCYb6sO977qtMcKXLXrtwx5fI3mkHYMrUI/AkJMXxrN8JofPWjbhaEFkFYQGm6Pl1U8aw=="}} {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:46:49.174084 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.quota [None req-8a4fce74-a00c-4fba-a0f3-4bab7fa2f1c6 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Getting quotas for project b6241924efa944a68503a87b695c7410. Resources: {'key_pairs'} {{(pid=124670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:46:49.184703 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.quota [None req-8a4fce74-a00c-4fba-a0f3-4bab7fa2f1c6 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Getting quotas for user bcd5fc6167654972868941ed28c327b6 and project b6241924efa944a68503a87b695c7410. Resources: {'key_pairs'} {{(pid=124670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:46:49.323479 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-8a4fce74-a00c-4fba-a0f3-4bab7fa2f1c6 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.191215 Jun 23 11:46:49.324666 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 201/373] 10.222.0.13 () {60 vars in 1158 bytes} [Thu Jun 23 11:46:49 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:46:49.745587 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.virt.hardware [None req-fb783441-ff0d-4931-ac49-25fd6c418c71 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Flavor limits 0:0:0 {{(pid=124669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 11:46:49.748245 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.virt.hardware [None req-fb783441-ff0d-4931-ac49-25fd6c418c71 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Image limits 0:0:0 {{(pid=124669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 11:46:49.752893 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.virt.hardware [None req-fb783441-ff0d-4931-ac49-25fd6c418c71 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Flavor pref 0:0:0 {{(pid=124669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 11:46:49.752893 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.virt.hardware [None req-fb783441-ff0d-4931-ac49-25fd6c418c71 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Image pref 0:0:0 {{(pid=124669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 11:46:49.752893 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.virt.hardware [None req-fb783441-ff0d-4931-ac49-25fd6c418c71 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 11:46:49.774019 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-fb783441-ff0d-4931-ac49-25fd6c418c71 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:49.775163 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-fb783441-ff0d-4931-ac49-25fd6c418c71 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:49.789810 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-fb783441-ff0d-4931-ac49-25fd6c418c71 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:49.789810 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-fb783441-ff0d-4931-ac49-25fd6c418c71 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:49.798826 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.quota [None req-fb783441-ff0d-4931-ac49-25fd6c418c71 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Getting quotas for project eb2187f9489844ab8bbf1f69df83b2de. Resources: {'cores', 'instances', 'ram'} {{(pid=124669) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:46:49.806971 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.quota [None req-fb783441-ff0d-4931-ac49-25fd6c418c71 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Getting quotas for user 5e0cc563017646f6acea9127f7f525ee and project eb2187f9489844ab8bbf1f69df83b2de. Resources: {'cores', 'instances', 'ram'} {{(pid=124669) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:46:49.821066 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-fb783441-ff0d-4931-ac49-25fd6c418c71 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Going to run 1 instances... {{(pid=124669) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 11:46:49.823503 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-fb783441-ff0d-4931-ac49-25fd6c418c71 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] [instance: a17006fa-d781-4551-a96c-1ca769325ae6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b19d6f23-214c-4432-bee6-455978023759',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124669) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 11:46:49.845712 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-ec47b9cb-ae90-451e-ac94-e4ed66bdd4a9 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:46:49.846324 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-ec47b9cb-ae90-451e-ac94-e4ed66bdd4a9 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] [instance: c026366c-311a-45eb-899c-30703cd7eb1d] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:46:49.852547 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-ec47b9cb-ae90-451e-ac94-e4ed66bdd4a9 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:49.853133 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-ec47b9cb-ae90-451e-ac94-e4ed66bdd4a9 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:49.853897 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-ec47b9cb-ae90-451e-ac94-e4ed66bdd4a9 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:49.854493 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-ec47b9cb-ae90-451e-ac94-e4ed66bdd4a9 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:50.051477 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-fb783441-ff0d-4931-ac49-25fd6c418c71 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.639281 Jun 23 11:46:50.060910 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 173/374] 10.222.0.13 () {60 vars in 1146 bytes} [Thu Jun 23 11:46:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1650 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 11:46:50.067801 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-2781cdfb-9292-421d-bfcd-31a141cb081f tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:46:50.068671 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-2781cdfb-9292-421d-bfcd-31a141cb081f tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] [instance: a17006fa-d781-4551-a96c-1ca769325ae6] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:46:50.328700 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-2781cdfb-9292-421d-bfcd-31a141cb081f tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0cc563017646f6acea9127f7f525ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2187f9489844ab8bbf1f69df83b2de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:50.337116 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-ec47b9cb-ae90-451e-ac94-e4ed66bdd4a9 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626c3dbdc0f1407db82d6988e68e40b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce01d9a78d3f4bb7b101b47548b73037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:50.349872 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-ec47b9cb-ae90-451e-ac94-e4ed66bdd4a9 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] 10.222.0.13 "GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d" status: 200 len: 1260 microversion: 2.1 time: 0.508183 Jun 23 11:46:50.353257 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-2781cdfb-9292-421d-bfcd-31a141cb081f tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] 10.222.0.13 "GET /compute/v2.1/servers/a17006fa-d781-4551-a96c-1ca769325ae6" status: 200 len: 1219 microversion: 2.1 time: 0.289070 Jun 23 11:46:50.359064 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 202/375] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:46:49 2022] GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d => generated 1260 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:46:50.359329 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 174/376] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:46:50 2022] GET /compute/v2.1/servers/a17006fa-d781-4551-a96c-1ca769325ae6 => generated 1219 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:46:50.543471 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [req-d8967fd3-d0e4-4280-afed-e71923155ef9 req-d337bdbc-3552-49bd-bfd8-7059ae459bd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c026366c-311a-45eb-899c-30703cd7eb1d", "tag": "0d774b3d-b1c7-415f-9da5-0abe6a54a4eb"}]} {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:46:50.565862 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-d8967fd3-d0e4-4280-afed-e71923155ef9 req-d337bdbc-3552-49bd-bfd8-7059ae459bd6 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:50.566557 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-d8967fd3-d0e4-4280-afed-e71923155ef9 req-d337bdbc-3552-49bd-bfd8-7059ae459bd6 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:50.580963 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.compute.server_external_events [req-d8967fd3-d0e4-4280-afed-e71923155ef9 req-d337bdbc-3552-49bd-bfd8-7059ae459bd6 service nova] Creating event network-changed:0d774b3d-b1c7-415f-9da5-0abe6a54a4eb for instance c026366c-311a-45eb-899c-30703cd7eb1d on hv-cinder-82099 Jun 23 11:46:50.591422 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [req-d8967fd3-d0e4-4280-afed-e71923155ef9 req-d337bdbc-3552-49bd-bfd8-7059ae459bd6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077381 Jun 23 11:46:50.592330 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 203/377] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:46:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:46:51.373542 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-80e8fc93-8359-4e2c-baf7-7cdc3ba28db2 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:46:51.376624 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-80e8fc93-8359-4e2c-baf7-7cdc3ba28db2 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] [instance: c026366c-311a-45eb-899c-30703cd7eb1d] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:46:51.382386 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-bbd1b584-a7cc-4445-8647-562c866635c9 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:46:51.383987 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-bbd1b584-a7cc-4445-8647-562c866635c9 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] [instance: a17006fa-d781-4551-a96c-1ca769325ae6] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:46:51.384678 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-80e8fc93-8359-4e2c-baf7-7cdc3ba28db2 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:51.385195 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-80e8fc93-8359-4e2c-baf7-7cdc3ba28db2 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:51.386659 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-80e8fc93-8359-4e2c-baf7-7cdc3ba28db2 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:51.388104 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-80e8fc93-8359-4e2c-baf7-7cdc3ba28db2 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:51.458036 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-bbd1b584-a7cc-4445-8647-562c866635c9 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0cc563017646f6acea9127f7f525ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2187f9489844ab8bbf1f69df83b2de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:51.466163 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-bbd1b584-a7cc-4445-8647-562c866635c9 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] 10.222.0.13 "GET /compute/v2.1/servers/a17006fa-d781-4551-a96c-1ca769325ae6" status: 200 len: 1219 microversion: 2.1 time: 0.088373 Jun 23 11:46:51.468174 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 204/378] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:46:51 2022] GET /compute/v2.1/servers/a17006fa-d781-4551-a96c-1ca769325ae6 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:46:51.607481 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-80e8fc93-8359-4e2c-baf7-7cdc3ba28db2 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626c3dbdc0f1407db82d6988e68e40b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce01d9a78d3f4bb7b101b47548b73037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:51.615823 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-80e8fc93-8359-4e2c-baf7-7cdc3ba28db2 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] 10.222.0.13 "GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d" status: 200 len: 1260 microversion: 2.1 time: 0.245976 Jun 23 11:46:51.616604 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 175/379] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:46:51 2022] GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d => generated 1260 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:46:52.484240 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-de6081d6-ebaa-42c4-bd8f-57449c11a83b tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:46:52.484845 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-de6081d6-ebaa-42c4-bd8f-57449c11a83b tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] [instance: a17006fa-d781-4551-a96c-1ca769325ae6] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:46:52.491513 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-de6081d6-ebaa-42c4-bd8f-57449c11a83b tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:52.492249 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-de6081d6-ebaa-42c4-bd8f-57449c11a83b tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:52.493189 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-de6081d6-ebaa-42c4-bd8f-57449c11a83b tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:52.493777 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-de6081d6-ebaa-42c4-bd8f-57449c11a83b tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:52.575158 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-de6081d6-ebaa-42c4-bd8f-57449c11a83b tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0cc563017646f6acea9127f7f525ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2187f9489844ab8bbf1f69df83b2de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:52.584264 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-de6081d6-ebaa-42c4-bd8f-57449c11a83b tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] 10.222.0.13 "GET /compute/v2.1/servers/a17006fa-d781-4551-a96c-1ca769325ae6" status: 200 len: 1215 microversion: 2.1 time: 0.103457 Jun 23 11:46:52.585457 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 205/380] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:46:52 2022] GET /compute/v2.1/servers/a17006fa-d781-4551-a96c-1ca769325ae6 => generated 1215 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:46:52.634823 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-fa07f101-5abb-46b1-a74a-ab9690641204 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:46:52.635447 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-fa07f101-5abb-46b1-a74a-ab9690641204 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] [instance: c026366c-311a-45eb-899c-30703cd7eb1d] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:46:52.642841 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-fa07f101-5abb-46b1-a74a-ab9690641204 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:52.644808 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-fa07f101-5abb-46b1-a74a-ab9690641204 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:52.646021 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-fa07f101-5abb-46b1-a74a-ab9690641204 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:52.646726 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-fa07f101-5abb-46b1-a74a-ab9690641204 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:52.809964 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-fa07f101-5abb-46b1-a74a-ab9690641204 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626c3dbdc0f1407db82d6988e68e40b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce01d9a78d3f4bb7b101b47548b73037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:52.826001 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-fa07f101-5abb-46b1-a74a-ab9690641204 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] 10.222.0.13 "GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d" status: 200 len: 1260 microversion: 2.1 time: 0.196335 Jun 23 11:46:52.836144 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 176/381] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:46:52 2022] GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d => generated 1260 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:46:53.332984 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-8620797e-e9f6-4eb3-b490-2d1b74cd0998 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1324450633", "imageRef": "b19d6f23-214c-4432-bee6-455978023759", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f1d4f6fa-8901-4f39-bc7b-fa92cecf023d"}], "security_groups": [{"name": "tempest-securitygroup--1623033283"}], "key_name": "tempest-keypair-241774240", "user_data": "}} {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:46:53.390013 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_cell0:SELECT=2 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:46:53.548353 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.network.neutron [None req-8620797e-e9f6-4eb3-b490-2d1b74cd0998 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] validate_networks() for [('f1d4f6fa-8901-4f39-bc7b-fa92cecf023d', None, None, None, None, None)] {{(pid=124670) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 11:46:53.609355 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-1b57e0f1-0e9d-4282-9696-2cbb383d4beb tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:46:53.609982 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-1b57e0f1-0e9d-4282-9696-2cbb383d4beb tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] [instance: a17006fa-d781-4551-a96c-1ca769325ae6] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:46:53.621239 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-1b57e0f1-0e9d-4282-9696-2cbb383d4beb tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:53.621695 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-1b57e0f1-0e9d-4282-9696-2cbb383d4beb tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:53.622553 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-1b57e0f1-0e9d-4282-9696-2cbb383d4beb tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:53.623656 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-1b57e0f1-0e9d-4282-9696-2cbb383d4beb tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:53.740599 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-1b57e0f1-0e9d-4282-9696-2cbb383d4beb tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0cc563017646f6acea9127f7f525ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2187f9489844ab8bbf1f69df83b2de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:53.753987 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-1b57e0f1-0e9d-4282-9696-2cbb383d4beb tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] 10.222.0.13 "GET /compute/v2.1/servers/a17006fa-d781-4551-a96c-1ca769325ae6" status: 200 len: 1271 microversion: 2.1 time: 0.152836 Jun 23 11:46:53.754669 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 177/382] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:46:53 2022] GET /compute/v2.1/servers/a17006fa-d781-4551-a96c-1ca769325ae6 => generated 1271 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:46:53.844571 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-e0065e1e-5138-44c1-abd1-ac5bfcc7e6dd tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:46:53.845682 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-e0065e1e-5138-44c1-abd1-ac5bfcc7e6dd tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] [instance: c026366c-311a-45eb-899c-30703cd7eb1d] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:46:53.853185 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-e0065e1e-5138-44c1-abd1-ac5bfcc7e6dd tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:53.853955 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-e0065e1e-5138-44c1-abd1-ac5bfcc7e6dd tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:53.854949 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-e0065e1e-5138-44c1-abd1-ac5bfcc7e6dd tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:53.855874 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-e0065e1e-5138-44c1-abd1-ac5bfcc7e6dd tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:54.562230 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.virt.hardware [None req-8620797e-e9f6-4eb3-b490-2d1b74cd0998 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Flavor limits 0:0:0 {{(pid=124670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 11:46:54.573284 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.virt.hardware [None req-8620797e-e9f6-4eb3-b490-2d1b74cd0998 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Image limits 0:0:0 {{(pid=124670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 11:46:54.573284 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.virt.hardware [None req-8620797e-e9f6-4eb3-b490-2d1b74cd0998 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Flavor pref 0:0:0 {{(pid=124670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 11:46:54.573284 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.virt.hardware [None req-8620797e-e9f6-4eb3-b490-2d1b74cd0998 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Image pref 0:0:0 {{(pid=124670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 11:46:54.573284 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.virt.hardware [None req-8620797e-e9f6-4eb3-b490-2d1b74cd0998 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 11:46:54.579041 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-8620797e-e9f6-4eb3-b490-2d1b74cd0998 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:54.579532 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-8620797e-e9f6-4eb3-b490-2d1b74cd0998 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:54.580373 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-8620797e-e9f6-4eb3-b490-2d1b74cd0998 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:54.580820 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-8620797e-e9f6-4eb3-b490-2d1b74cd0998 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:54.600956 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:46:54.610465 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.quota [None req-8620797e-e9f6-4eb3-b490-2d1b74cd0998 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Getting quotas for project b6241924efa944a68503a87b695c7410. Resources: {'cores', 'instances', 'ram'} {{(pid=124670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:46:54.614875 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.quota [None req-8620797e-e9f6-4eb3-b490-2d1b74cd0998 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Getting quotas for user bcd5fc6167654972868941ed28c327b6 and project b6241924efa944a68503a87b695c7410. Resources: {'cores', 'instances', 'ram'} {{(pid=124670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:46:54.631997 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-e0065e1e-5138-44c1-abd1-ac5bfcc7e6dd tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626c3dbdc0f1407db82d6988e68e40b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce01d9a78d3f4bb7b101b47548b73037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:54.640434 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-e0065e1e-5138-44c1-abd1-ac5bfcc7e6dd tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] 10.222.0.13 "GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d" status: 200 len: 1260 microversion: 2.1 time: 0.800187 Jun 23 11:46:54.643625 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 178/383] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:46:53 2022] GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d => generated 1260 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:46:54.647697 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-8620797e-e9f6-4eb3-b490-2d1b74cd0998 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Going to run 1 instances... {{(pid=124670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 11:46:54.651039 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-8620797e-e9f6-4eb3-b490-2d1b74cd0998 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 6b648e87-b71a-4ef3-aada-f884b8efb154] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b19d6f23-214c-4432-bee6-455978023759',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 11:46:54.772714 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-6ad843c5-7585-457f-ab43-3ca515adef49 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:46:54.775474 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-6ad843c5-7585-457f-ab43-3ca515adef49 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] [instance: a17006fa-d781-4551-a96c-1ca769325ae6] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:46:54.783959 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-6ad843c5-7585-457f-ab43-3ca515adef49 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:54.789699 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-6ad843c5-7585-457f-ab43-3ca515adef49 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:54.789699 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-6ad843c5-7585-457f-ab43-3ca515adef49 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:54.789699 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-6ad843c5-7585-457f-ab43-3ca515adef49 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:54.801935 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-8620797e-e9f6-4eb3-b490-2d1b74cd0998 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.473147 Jun 23 11:46:54.802642 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 206/384] 10.222.0.13 () {60 vars in 1146 bytes} [Thu Jun 23 11:46:53 2022] POST /compute/v2.1/servers => generated 409 bytes in 1475 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 11:46:54.822220 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-088d52d9-e362-44de-83cc-8a9f868043e9 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:46:54.840890 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-088d52d9-e362-44de-83cc-8a9f868043e9 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 6b648e87-b71a-4ef3-aada-f884b8efb154] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:46:54.975301 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-088d52d9-e362-44de-83cc-8a9f868043e9 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:54.996863 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-088d52d9-e362-44de-83cc-8a9f868043e9 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154" status: 200 len: 1245 microversion: 2.1 time: 0.181478 Jun 23 11:46:54.997674 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 207/385] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:46:54 2022] GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154 => generated 1245 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:46:55.046522 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-6ad843c5-7585-457f-ab43-3ca515adef49 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0cc563017646f6acea9127f7f525ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2187f9489844ab8bbf1f69df83b2de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:55.055749 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-6ad843c5-7585-457f-ab43-3ca515adef49 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] 10.222.0.13 "GET /compute/v2.1/servers/a17006fa-d781-4551-a96c-1ca769325ae6" status: 200 len: 1277 microversion: 2.1 time: 0.288742 Jun 23 11:46:55.057373 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 179/386] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:46:54 2022] GET /compute/v2.1/servers/a17006fa-d781-4551-a96c-1ca769325ae6 => generated 1277 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:46:55.659957 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-f9dfacc4-1ab2-4051-8dbf-a5b3d8b5aee3 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:46:55.660621 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-f9dfacc4-1ab2-4051-8dbf-a5b3d8b5aee3 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] [instance: c026366c-311a-45eb-899c-30703cd7eb1d] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:46:55.670362 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-f9dfacc4-1ab2-4051-8dbf-a5b3d8b5aee3 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:55.671158 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-f9dfacc4-1ab2-4051-8dbf-a5b3d8b5aee3 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:55.671991 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-f9dfacc4-1ab2-4051-8dbf-a5b3d8b5aee3 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:55.672612 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-f9dfacc4-1ab2-4051-8dbf-a5b3d8b5aee3 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:55.974878 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-f9dfacc4-1ab2-4051-8dbf-a5b3d8b5aee3 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626c3dbdc0f1407db82d6988e68e40b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce01d9a78d3f4bb7b101b47548b73037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:55.987185 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-f9dfacc4-1ab2-4051-8dbf-a5b3d8b5aee3 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] 10.222.0.13 "GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d" status: 200 len: 1260 microversion: 2.1 time: 0.331059 Jun 23 11:46:55.989969 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 208/387] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:46:55 2022] GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d => generated 1260 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:46:56.014512 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-fe561508-4077-4d31-acec-2b688109831a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:46:56.015149 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-fe561508-4077-4d31-acec-2b688109831a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 6b648e87-b71a-4ef3-aada-f884b8efb154] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:46:56.025597 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-fe561508-4077-4d31-acec-2b688109831a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:56.026058 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-fe561508-4077-4d31-acec-2b688109831a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:56.031336 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-fe561508-4077-4d31-acec-2b688109831a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:56.031336 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-fe561508-4077-4d31-acec-2b688109831a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:56.074064 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-3f571b16-a284-4560-af56-2a4a6b8e9ecd tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:46:56.076151 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-3f571b16-a284-4560-af56-2a4a6b8e9ecd tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] [instance: a17006fa-d781-4551-a96c-1ca769325ae6] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:46:56.084776 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-3f571b16-a284-4560-af56-2a4a6b8e9ecd tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:56.085232 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-3f571b16-a284-4560-af56-2a4a6b8e9ecd tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:56.086504 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-3f571b16-a284-4560-af56-2a4a6b8e9ecd tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:56.086860 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-3f571b16-a284-4560-af56-2a4a6b8e9ecd tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:56.134636 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-fe561508-4077-4d31-acec-2b688109831a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:56.142679 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-fe561508-4077-4d31-acec-2b688109831a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154" status: 200 len: 1249 microversion: 2.1 time: 0.133006 Jun 23 11:46:56.159564 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 180/388] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:46:56 2022] GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154 => generated 1249 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:46:56.293431 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-3f571b16-a284-4560-af56-2a4a6b8e9ecd tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0cc563017646f6acea9127f7f525ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2187f9489844ab8bbf1f69df83b2de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:56.307088 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-3f571b16-a284-4560-af56-2a4a6b8e9ecd tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] 10.222.0.13 "GET /compute/v2.1/servers/a17006fa-d781-4551-a96c-1ca769325ae6" status: 200 len: 1319 microversion: 2.1 time: 0.236533 Jun 23 11:46:56.317593 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 209/389] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:46:56 2022] GET /compute/v2.1/servers/a17006fa-d781-4551-a96c-1ca769325ae6 => generated 1319 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:46:56.508374 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [req-7c3c1442-d659-4a2f-87b2-7488d0a89537 req-a1ca5c59-7525-4d39-bbdf-fb880cc9af0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a17006fa-d781-4551-a96c-1ca769325ae6", "tag": "1796d8a3-7f26-4cbc-8fbf-966361d393ae"}]} {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:46:56.518596 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [req-7c3c1442-d659-4a2f-87b2-7488d0a89537 req-a1ca5c59-7525-4d39-bbdf-fb880cc9af0c service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:56.519543 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [req-7c3c1442-d659-4a2f-87b2-7488d0a89537 req-a1ca5c59-7525-4d39-bbdf-fb880cc9af0c service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:56.534497 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.compute.server_external_events [req-7c3c1442-d659-4a2f-87b2-7488d0a89537 req-a1ca5c59-7525-4d39-bbdf-fb880cc9af0c service nova] Creating event network-changed:1796d8a3-7f26-4cbc-8fbf-966361d393ae for instance a17006fa-d781-4551-a96c-1ca769325ae6 on hv-cinder-82099 Jun 23 11:46:56.541345 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [req-7c3c1442-d659-4a2f-87b2-7488d0a89537 req-a1ca5c59-7525-4d39-bbdf-fb880cc9af0c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036920 Jun 23 11:46:56.541953 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 181/390] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:46:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:46:57.012416 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-d2e3ed6f-550e-432c-9f3e-de25a0ffd1d1 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:46:57.013036 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-d2e3ed6f-550e-432c-9f3e-de25a0ffd1d1 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] [instance: c026366c-311a-45eb-899c-30703cd7eb1d] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:46:57.030839 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-d2e3ed6f-550e-432c-9f3e-de25a0ffd1d1 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:57.039090 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-d2e3ed6f-550e-432c-9f3e-de25a0ffd1d1 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:57.045461 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-d2e3ed6f-550e-432c-9f3e-de25a0ffd1d1 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:57.045461 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-d2e3ed6f-550e-432c-9f3e-de25a0ffd1d1 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:57.161238 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-2d6ae6dc-7091-4184-a490-e6633e82e587 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:46:57.161956 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-2d6ae6dc-7091-4184-a490-e6633e82e587 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 6b648e87-b71a-4ef3-aada-f884b8efb154] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:46:57.176404 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-2d6ae6dc-7091-4184-a490-e6633e82e587 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:57.177149 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-2d6ae6dc-7091-4184-a490-e6633e82e587 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:57.178218 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-2d6ae6dc-7091-4184-a490-e6633e82e587 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:57.179072 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-2d6ae6dc-7091-4184-a490-e6633e82e587 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:57.316169 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-2d6ae6dc-7091-4184-a490-e6633e82e587 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:57.328239 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-2d6ae6dc-7091-4184-a490-e6633e82e587 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154" status: 200 len: 1305 microversion: 2.1 time: 0.172179 Jun 23 11:46:57.329548 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 182/391] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:46:57 2022] GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154 => generated 1305 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:46:57.337659 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-b8b53531-63fb-4b93-8865-354c58238ef0 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:46:57.338940 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-b8b53531-63fb-4b93-8865-354c58238ef0 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] [instance: a17006fa-d781-4551-a96c-1ca769325ae6] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:46:57.352517 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-b8b53531-63fb-4b93-8865-354c58238ef0 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:57.354093 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-b8b53531-63fb-4b93-8865-354c58238ef0 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:57.355781 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-b8b53531-63fb-4b93-8865-354c58238ef0 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:57.356451 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-b8b53531-63fb-4b93-8865-354c58238ef0 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:57.382202 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-d2e3ed6f-550e-432c-9f3e-de25a0ffd1d1 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626c3dbdc0f1407db82d6988e68e40b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce01d9a78d3f4bb7b101b47548b73037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:57.389857 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_cell1:SELECT=100 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:46:57.395770 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-d2e3ed6f-550e-432c-9f3e-de25a0ffd1d1 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] 10.222.0.13 "GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d" status: 200 len: 1260 microversion: 2.1 time: 0.392707 Jun 23 11:46:57.397042 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 210/392] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:46:57 2022] GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d => generated 1260 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:46:57.712349 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-b8b53531-63fb-4b93-8865-354c58238ef0 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0cc563017646f6acea9127f7f525ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2187f9489844ab8bbf1f69df83b2de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:57.719686 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-b8b53531-63fb-4b93-8865-354c58238ef0 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] 10.222.0.13 "GET /compute/v2.1/servers/a17006fa-d781-4551-a96c-1ca769325ae6" status: 200 len: 1319 microversion: 2.1 time: 0.388840 Jun 23 11:46:57.720258 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 183/393] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:46:57 2022] GET /compute/v2.1/servers/a17006fa-d781-4551-a96c-1ca769325ae6 => generated 1319 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:46:58.347389 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-a2142429-7a8b-407c-839e-236e00e5948f tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:46:58.348144 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-a2142429-7a8b-407c-839e-236e00e5948f tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 6b648e87-b71a-4ef3-aada-f884b8efb154] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:46:58.354800 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a2142429-7a8b-407c-839e-236e00e5948f tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:58.355249 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a2142429-7a8b-407c-839e-236e00e5948f tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:58.356014 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a2142429-7a8b-407c-839e-236e00e5948f tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:58.356787 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a2142429-7a8b-407c-839e-236e00e5948f tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:58.414448 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-88223bdf-35f1-4788-92d7-929d03283215 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:46:58.415151 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-88223bdf-35f1-4788-92d7-929d03283215 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] [instance: c026366c-311a-45eb-899c-30703cd7eb1d] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:46:58.422149 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-88223bdf-35f1-4788-92d7-929d03283215 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:58.422707 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-88223bdf-35f1-4788-92d7-929d03283215 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:58.423477 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-88223bdf-35f1-4788-92d7-929d03283215 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:58.423903 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-88223bdf-35f1-4788-92d7-929d03283215 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:58.959856 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-a2142429-7a8b-407c-839e-236e00e5948f tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:58.975751 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-88223bdf-35f1-4788-92d7-929d03283215 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626c3dbdc0f1407db82d6988e68e40b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce01d9a78d3f4bb7b101b47548b73037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:58.986080 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-88223bdf-35f1-4788-92d7-929d03283215 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] 10.222.0.13 "GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d" status: 200 len: 1260 microversion: 2.1 time: 0.576656 Jun 23 11:46:58.994225 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-a2142429-7a8b-407c-839e-236e00e5948f tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154" status: 200 len: 1371 microversion: 2.1 time: 0.651044 Jun 23 11:46:58.996485 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 184/394] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:46:58 2022] GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d => generated 1260 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:46:59.001657 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-e41a420c-7709-4004-8d16-8dc4005602d0 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:46:59.002515 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-e41a420c-7709-4004-8d16-8dc4005602d0 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] [instance: a17006fa-d781-4551-a96c-1ca769325ae6] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:46:59.006232 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 211/395] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:46:58 2022] GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154 => generated 1371 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:46:59.011090 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-e41a420c-7709-4004-8d16-8dc4005602d0 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:59.011618 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-e41a420c-7709-4004-8d16-8dc4005602d0 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:59.012460 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-e41a420c-7709-4004-8d16-8dc4005602d0 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:59.012973 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-e41a420c-7709-4004-8d16-8dc4005602d0 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:59.164510 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-e41a420c-7709-4004-8d16-8dc4005602d0 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0cc563017646f6acea9127f7f525ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2187f9489844ab8bbf1f69df83b2de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:46:59.170350 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-e41a420c-7709-4004-8d16-8dc4005602d0 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] 10.222.0.13 "GET /compute/v2.1/servers/a17006fa-d781-4551-a96c-1ca769325ae6" status: 200 len: 1319 microversion: 2.1 time: 0.172496 Jun 23 11:46:59.171877 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 185/396] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:46:58 2022] GET /compute/v2.1/servers/a17006fa-d781-4551-a96c-1ca769325ae6 => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:47:00.003609 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-7a902652-7048-4b5b-9a7e-f3d37ee92875 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:47:00.004292 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-7a902652-7048-4b5b-9a7e-f3d37ee92875 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] [instance: c026366c-311a-45eb-899c-30703cd7eb1d] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:47:00.010563 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_cell0:SELECT=2 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:47:00.016520 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-7a902652-7048-4b5b-9a7e-f3d37ee92875 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:00.016520 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-7a902652-7048-4b5b-9a7e-f3d37ee92875 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:00.016520 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-7a902652-7048-4b5b-9a7e-f3d37ee92875 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:00.016520 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-7a902652-7048-4b5b-9a7e-f3d37ee92875 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:00.161691 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-7a902652-7048-4b5b-9a7e-f3d37ee92875 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626c3dbdc0f1407db82d6988e68e40b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce01d9a78d3f4bb7b101b47548b73037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:47:00.171809 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-7a902652-7048-4b5b-9a7e-f3d37ee92875 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] 10.222.0.13 "GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d" status: 200 len: 1260 microversion: 2.1 time: 0.171928 Jun 23 11:47:00.172542 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 186/397] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:46:59 2022] GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d => generated 1260 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:47:00.177206 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-38bc63f9-e3c8-44ea-b2f1-6a7e5760847a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:47:00.177814 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-38bc63f9-e3c8-44ea-b2f1-6a7e5760847a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 6b648e87-b71a-4ef3-aada-f884b8efb154] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:47:00.186868 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-38bc63f9-e3c8-44ea-b2f1-6a7e5760847a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:00.187316 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-38bc63f9-e3c8-44ea-b2f1-6a7e5760847a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:00.188069 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-38bc63f9-e3c8-44ea-b2f1-6a7e5760847a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:00.188503 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-38bc63f9-e3c8-44ea-b2f1-6a7e5760847a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:00.194518 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-78c8fafc-4ae7-4cd0-8e71-847915ba00fa tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Action: 'create', calling method: .version_select at 0x7f5d069c8430>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-367548420", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPQyMkwJ2+j1rS0g/lrw3i0S42doS8ZZ6LPTXhy2QuuB4SzG12zUpwKOCb/qS/lUf7k4HYH6nBxyTF8xlbx0N1V/sd9xObcslZF8alUtcQnTEST00lNvTXKrNmQsDN+x7g=="}} {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:47:00.199472 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:47:00.211721 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.quota [None req-78c8fafc-4ae7-4cd0-8e71-847915ba00fa tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Getting quotas for project 2e810a9bc3b44c4aa8ca2ddd0fa68f7b. Resources: {'key_pairs'} {{(pid=124670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:47:00.216704 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.quota [None req-78c8fafc-4ae7-4cd0-8e71-847915ba00fa tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Getting quotas for user 6cc5a4676f6a416cbdc8c67ebd80cdf3 and project 2e810a9bc3b44c4aa8ca2ddd0fa68f7b. Resources: {'key_pairs'} {{(pid=124670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:47:00.323999 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-38bc63f9-e3c8-44ea-b2f1-6a7e5760847a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:47:00.331612 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-38bc63f9-e3c8-44ea-b2f1-6a7e5760847a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154" status: 200 len: 1371 microversion: 2.1 time: 0.157964 Jun 23 11:47:00.336158 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 187/398] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:47:00 2022] GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154 => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:47:00.337457 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-d298e8da-be56-427d-a030-0438fb0e17ff tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:47:00.338084 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-d298e8da-be56-427d-a030-0438fb0e17ff tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] [instance: a17006fa-d781-4551-a96c-1ca769325ae6] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:47:00.343820 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-d298e8da-be56-427d-a030-0438fb0e17ff tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:00.344275 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-d298e8da-be56-427d-a030-0438fb0e17ff tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:00.345012 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-d298e8da-be56-427d-a030-0438fb0e17ff tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:00.345436 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-d298e8da-be56-427d-a030-0438fb0e17ff tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:00.349379 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_cell0:SELECT=12 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:47:00.368135 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-78c8fafc-4ae7-4cd0-8e71-847915ba00fa tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.395947 Jun 23 11:47:00.368652 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 212/399] 10.222.0.13 () {60 vars in 1158 bytes} [Thu Jun 23 11:46:59 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:47:00.495335 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-d298e8da-be56-427d-a030-0438fb0e17ff tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0cc563017646f6acea9127f7f525ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2187f9489844ab8bbf1f69df83b2de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:47:00.502697 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-d298e8da-be56-427d-a030-0438fb0e17ff tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] 10.222.0.13 "GET /compute/v2.1/servers/a17006fa-d781-4551-a96c-1ca769325ae6" status: 200 len: 1319 microversion: 2.1 time: 0.169510 Jun 23 11:47:00.503248 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 188/400] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:47:00 2022] GET /compute/v2.1/servers/a17006fa-d781-4551-a96c-1ca769325ae6 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:47:01.190003 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-6c4d35f2-9602-4f56-8f08-e342a18d2196 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:47:01.190904 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-6c4d35f2-9602-4f56-8f08-e342a18d2196 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] [instance: c026366c-311a-45eb-899c-30703cd7eb1d] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:47:01.207056 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-6c4d35f2-9602-4f56-8f08-e342a18d2196 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:01.207579 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-6c4d35f2-9602-4f56-8f08-e342a18d2196 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:01.208752 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-6c4d35f2-9602-4f56-8f08-e342a18d2196 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:01.211506 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-6c4d35f2-9602-4f56-8f08-e342a18d2196 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:01.349523 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-b4548fee-bdfd-4d45-8ad3-4210d279e8fa tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:47:01.350018 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-b4548fee-bdfd-4d45-8ad3-4210d279e8fa tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 6b648e87-b71a-4ef3-aada-f884b8efb154] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:47:01.373822 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-b4548fee-bdfd-4d45-8ad3-4210d279e8fa tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:01.374398 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-b4548fee-bdfd-4d45-8ad3-4210d279e8fa tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:01.375454 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-b4548fee-bdfd-4d45-8ad3-4210d279e8fa tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:01.376049 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-b4548fee-bdfd-4d45-8ad3-4210d279e8fa tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:01.458150 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-6c4d35f2-9602-4f56-8f08-e342a18d2196 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626c3dbdc0f1407db82d6988e68e40b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce01d9a78d3f4bb7b101b47548b73037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:47:01.473419 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-6c4d35f2-9602-4f56-8f08-e342a18d2196 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] 10.222.0.13 "GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d" status: 200 len: 1260 microversion: 2.1 time: 0.287798 Jun 23 11:47:01.476178 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 213/401] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:47:01 2022] GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d => generated 1260 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:47:01.522770 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-72d69c79-2022-4a38-8205-f1456218bedb tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:47:01.524438 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-72d69c79-2022-4a38-8205-f1456218bedb tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] [instance: a17006fa-d781-4551-a96c-1ca769325ae6] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:47:01.532667 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-72d69c79-2022-4a38-8205-f1456218bedb tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:01.533348 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-72d69c79-2022-4a38-8205-f1456218bedb tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:01.534445 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-72d69c79-2022-4a38-8205-f1456218bedb tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:01.535063 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-72d69c79-2022-4a38-8205-f1456218bedb tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:01.701273 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-b4548fee-bdfd-4d45-8ad3-4210d279e8fa tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:47:01.709617 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-b4548fee-bdfd-4d45-8ad3-4210d279e8fa tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154" status: 200 len: 1371 microversion: 2.1 time: 0.364257 Jun 23 11:47:01.710464 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 189/402] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:47:01 2022] GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154 => generated 1371 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:47:01.752472 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-72d69c79-2022-4a38-8205-f1456218bedb tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0cc563017646f6acea9127f7f525ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2187f9489844ab8bbf1f69df83b2de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:47:01.761008 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-72d69c79-2022-4a38-8205-f1456218bedb tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] 10.222.0.13 "GET /compute/v2.1/servers/a17006fa-d781-4551-a96c-1ca769325ae6" status: 200 len: 1319 microversion: 2.1 time: 0.243908 Jun 23 11:47:01.761577 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 214/403] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:47:01 2022] GET /compute/v2.1/servers/a17006fa-d781-4551-a96c-1ca769325ae6 => generated 1319 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:47:01.872654 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [req-16917e67-cfe1-4d00-89f6-2fd65395e63f req-a03588b7-96e1-4a0b-b10b-ff1f6f8a6f07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b648e87-b71a-4ef3-aada-f884b8efb154", "tag": "cae1bf17-0db1-4c4a-8280-5a78b15781a7"}]} {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:47:01.892894 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [req-16917e67-cfe1-4d00-89f6-2fd65395e63f req-a03588b7-96e1-4a0b-b10b-ff1f6f8a6f07 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:01.894201 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [req-16917e67-cfe1-4d00-89f6-2fd65395e63f req-a03588b7-96e1-4a0b-b10b-ff1f6f8a6f07 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:01.921928 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.compute.server_external_events [req-16917e67-cfe1-4d00-89f6-2fd65395e63f req-a03588b7-96e1-4a0b-b10b-ff1f6f8a6f07 service nova] Creating event network-changed:cae1bf17-0db1-4c4a-8280-5a78b15781a7 for instance 6b648e87-b71a-4ef3-aada-f884b8efb154 on hv-cinder-82099 Jun 23 11:47:01.928754 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [req-16917e67-cfe1-4d00-89f6-2fd65395e63f req-a03588b7-96e1-4a0b-b10b-ff1f6f8a6f07 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071838 Jun 23 11:47:01.931322 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 190/404] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:47:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:47:02.502118 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-83f37087-9a13-4e8a-ac60-2fe9abd84c4e tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:47:02.502772 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-83f37087-9a13-4e8a-ac60-2fe9abd84c4e tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] [instance: c026366c-311a-45eb-899c-30703cd7eb1d] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:47:02.509953 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-83f37087-9a13-4e8a-ac60-2fe9abd84c4e tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:02.510443 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-83f37087-9a13-4e8a-ac60-2fe9abd84c4e tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:02.511302 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-83f37087-9a13-4e8a-ac60-2fe9abd84c4e tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:02.511767 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-83f37087-9a13-4e8a-ac60-2fe9abd84c4e tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:02.717921 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-83f37087-9a13-4e8a-ac60-2fe9abd84c4e tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626c3dbdc0f1407db82d6988e68e40b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce01d9a78d3f4bb7b101b47548b73037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:47:02.729538 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-03e5fb54-1c52-47d4-abc1-f7bb797ab607 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:47:02.730235 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-03e5fb54-1c52-47d4-abc1-f7bb797ab607 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 6b648e87-b71a-4ef3-aada-f884b8efb154] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:47:02.736822 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-83f37087-9a13-4e8a-ac60-2fe9abd84c4e tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] 10.222.0.13 "GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d" status: 200 len: 1260 microversion: 2.1 time: 0.247612 Jun 23 11:47:02.738740 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 215/405] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:47:02 2022] GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d => generated 1260 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:47:02.745494 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-03e5fb54-1c52-47d4-abc1-f7bb797ab607 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:02.746045 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-03e5fb54-1c52-47d4-abc1-f7bb797ab607 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:02.746945 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-03e5fb54-1c52-47d4-abc1-f7bb797ab607 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:02.747465 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-03e5fb54-1c52-47d4-abc1-f7bb797ab607 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:02.779756 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-b8becf1f-3c5b-4906-8bbf-b73efe55361d tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:47:02.780506 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-b8becf1f-3c5b-4906-8bbf-b73efe55361d tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] [instance: a17006fa-d781-4551-a96c-1ca769325ae6] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:47:02.792643 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-b8becf1f-3c5b-4906-8bbf-b73efe55361d tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:02.793795 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-b8becf1f-3c5b-4906-8bbf-b73efe55361d tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:02.795794 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-b8becf1f-3c5b-4906-8bbf-b73efe55361d tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:02.796972 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-b8becf1f-3c5b-4906-8bbf-b73efe55361d tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:03.092733 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-b8becf1f-3c5b-4906-8bbf-b73efe55361d tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0cc563017646f6acea9127f7f525ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2187f9489844ab8bbf1f69df83b2de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:47:03.093164 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-03e5fb54-1c52-47d4-abc1-f7bb797ab607 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:47:03.101971 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-b8becf1f-3c5b-4906-8bbf-b73efe55361d tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] 10.222.0.13 "GET /compute/v2.1/servers/a17006fa-d781-4551-a96c-1ca769325ae6" status: 200 len: 1319 microversion: 2.1 time: 0.327253 Jun 23 11:47:03.105890 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-03e5fb54-1c52-47d4-abc1-f7bb797ab607 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154" status: 200 len: 1371 microversion: 2.1 time: 0.381113 Jun 23 11:47:03.106774 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 191/406] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:47:02 2022] GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154 => generated 1371 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:47:03.112198 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 216/407] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:47:02 2022] GET /compute/v2.1/servers/a17006fa-d781-4551-a96c-1ca769325ae6 => generated 1319 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:47:03.439812 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [req-6b66ff20-955d-4c1e-a449-9deabd2693b6 req-d16e85d5-b584-4520-b50e-6477208ac2e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a17006fa-d781-4551-a96c-1ca769325ae6", "name": "network-vif-plugged", "status": "completed", "tag": "1796d8a3-7f26-4cbc-8fbf-966361d393ae"}]} {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:47:03.449844 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [req-6b66ff20-955d-4c1e-a449-9deabd2693b6 req-d16e85d5-b584-4520-b50e-6477208ac2e9 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:03.450255 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [req-6b66ff20-955d-4c1e-a449-9deabd2693b6 req-d16e85d5-b584-4520-b50e-6477208ac2e9 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:03.464236 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.compute.server_external_events [req-6b66ff20-955d-4c1e-a449-9deabd2693b6 req-d16e85d5-b584-4520-b50e-6477208ac2e9 service nova] Creating event network-vif-plugged:1796d8a3-7f26-4cbc-8fbf-966361d393ae for instance a17006fa-d781-4551-a96c-1ca769325ae6 on hv-cinder-82099 Jun 23 11:47:03.469533 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [req-6b66ff20-955d-4c1e-a449-9deabd2693b6 req-d16e85d5-b584-4520-b50e-6477208ac2e9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033272 Jun 23 11:47:03.470636 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 192/408] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:47:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:47:03.755432 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-c80653a0-6caa-43d5-9509-f10aadcef137 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:47:03.756200 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-c80653a0-6caa-43d5-9509-f10aadcef137 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] [instance: c026366c-311a-45eb-899c-30703cd7eb1d] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:47:03.762901 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-c80653a0-6caa-43d5-9509-f10aadcef137 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:03.763785 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-c80653a0-6caa-43d5-9509-f10aadcef137 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:03.764668 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-c80653a0-6caa-43d5-9509-f10aadcef137 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:03.765158 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-c80653a0-6caa-43d5-9509-f10aadcef137 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:03.934499 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-c80653a0-6caa-43d5-9509-f10aadcef137 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626c3dbdc0f1407db82d6988e68e40b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce01d9a78d3f4bb7b101b47548b73037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:47:03.948373 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-c80653a0-6caa-43d5-9509-f10aadcef137 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] 10.222.0.13 "GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d" status: 200 len: 1260 microversion: 2.1 time: 0.197345 Jun 23 11:47:03.948948 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 217/409] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:47:03 2022] GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d => generated 1260 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:47:04.121094 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-b801582c-f077-4efb-a938-813e76997436 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:47:04.121796 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-b801582c-f077-4efb-a938-813e76997436 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] [instance: a17006fa-d781-4551-a96c-1ca769325ae6] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:47:04.123579 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-9965c03f-cd49-42e0-be19-acab17a6ef8e tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:47:04.124299 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-9965c03f-cd49-42e0-be19-acab17a6ef8e tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 6b648e87-b71a-4ef3-aada-f884b8efb154] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:47:04.132541 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-9965c03f-cd49-42e0-be19-acab17a6ef8e tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:04.132836 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-9965c03f-cd49-42e0-be19-acab17a6ef8e tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:04.133709 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-b801582c-f077-4efb-a938-813e76997436 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:04.133827 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-9965c03f-cd49-42e0-be19-acab17a6ef8e tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:04.134159 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-b801582c-f077-4efb-a938-813e76997436 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:04.134257 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-9965c03f-cd49-42e0-be19-acab17a6ef8e tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:04.134956 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-b801582c-f077-4efb-a938-813e76997436 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:04.135386 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-b801582c-f077-4efb-a938-813e76997436 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:04.337598 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-b801582c-f077-4efb-a938-813e76997436 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0cc563017646f6acea9127f7f525ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2187f9489844ab8bbf1f69df83b2de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:47:04.340435 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-9965c03f-cd49-42e0-be19-acab17a6ef8e tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:47:04.346061 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-b801582c-f077-4efb-a938-813e76997436 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] 10.222.0.13 "GET /compute/v2.1/servers/a17006fa-d781-4551-a96c-1ca769325ae6" status: 200 len: 1319 microversion: 2.1 time: 0.230800 Jun 23 11:47:04.348548 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-9965c03f-cd49-42e0-be19-acab17a6ef8e tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154" status: 200 len: 1371 microversion: 2.1 time: 0.229319 Jun 23 11:47:04.349112 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 218/410] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:47:04 2022] GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154 => generated 1371 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:47:04.359017 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 193/411] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:47:04 2022] GET /compute/v2.1/servers/a17006fa-d781-4551-a96c-1ca769325ae6 => generated 1319 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:47:04.967848 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-10988b5d-faa1-478b-b26e-920ab917a9b1 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:47:04.968492 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-10988b5d-faa1-478b-b26e-920ab917a9b1 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] [instance: c026366c-311a-45eb-899c-30703cd7eb1d] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:47:04.970351 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_cell0:SELECT=2 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:47:04.975353 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-10988b5d-faa1-478b-b26e-920ab917a9b1 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:04.975801 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-10988b5d-faa1-478b-b26e-920ab917a9b1 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:04.976558 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-10988b5d-faa1-478b-b26e-920ab917a9b1 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:04.976990 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-10988b5d-faa1-478b-b26e-920ab917a9b1 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:05.116318 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-10988b5d-faa1-478b-b26e-920ab917a9b1 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626c3dbdc0f1407db82d6988e68e40b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce01d9a78d3f4bb7b101b47548b73037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:47:05.125734 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-10988b5d-faa1-478b-b26e-920ab917a9b1 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] 10.222.0.13 "GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d" status: 200 len: 1260 microversion: 2.1 time: 0.161725 Jun 23 11:47:05.126593 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 219/412] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:47:04 2022] GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:47:05.364716 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-3f201af7-479f-4b6f-92d2-63b5ec45cacc tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:47:05.366034 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-3f201af7-479f-4b6f-92d2-63b5ec45cacc tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] [instance: a17006fa-d781-4551-a96c-1ca769325ae6] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:47:05.368055 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-1d9414e8-63ec-4984-b77b-e724d959000a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:47:05.368783 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-1d9414e8-63ec-4984-b77b-e724d959000a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 6b648e87-b71a-4ef3-aada-f884b8efb154] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:47:05.375118 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:47:05.375340 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1d9414e8-63ec-4984-b77b-e724d959000a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:05.375792 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1d9414e8-63ec-4984-b77b-e724d959000a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:05.376006 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-3f201af7-479f-4b6f-92d2-63b5ec45cacc tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:05.376465 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-3f201af7-479f-4b6f-92d2-63b5ec45cacc tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:05.376613 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1d9414e8-63ec-4984-b77b-e724d959000a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:05.377003 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1d9414e8-63ec-4984-b77b-e724d959000a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:05.377262 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-3f201af7-479f-4b6f-92d2-63b5ec45cacc tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:05.377721 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-3f201af7-479f-4b6f-92d2-63b5ec45cacc tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:05.593370 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-1d9414e8-63ec-4984-b77b-e724d959000a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:47:05.597342 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-3f201af7-479f-4b6f-92d2-63b5ec45cacc tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0cc563017646f6acea9127f7f525ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2187f9489844ab8bbf1f69df83b2de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:47:05.601740 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-1d9414e8-63ec-4984-b77b-e724d959000a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154" status: 200 len: 1371 microversion: 2.1 time: 0.238600 Jun 23 11:47:05.602401 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 220/413] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:47:05 2022] GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154 => generated 1371 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:47:05.606491 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-3f201af7-479f-4b6f-92d2-63b5ec45cacc tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] 10.222.0.13 "GET /compute/v2.1/servers/a17006fa-d781-4551-a96c-1ca769325ae6" status: 200 len: 1319 microversion: 2.1 time: 0.246167 Jun 23 11:47:05.607097 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 194/414] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:47:05 2022] GET /compute/v2.1/servers/a17006fa-d781-4551-a96c-1ca769325ae6 => generated 1319 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:47:06.142744 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-11670e45-026a-4133-be2d-464122954742 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:47:06.143320 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-11670e45-026a-4133-be2d-464122954742 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] [instance: c026366c-311a-45eb-899c-30703cd7eb1d] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:47:06.150621 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-11670e45-026a-4133-be2d-464122954742 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:06.151078 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-11670e45-026a-4133-be2d-464122954742 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:06.151849 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-11670e45-026a-4133-be2d-464122954742 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:06.152292 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-11670e45-026a-4133-be2d-464122954742 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:06.285784 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-11670e45-026a-4133-be2d-464122954742 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626c3dbdc0f1407db82d6988e68e40b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce01d9a78d3f4bb7b101b47548b73037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:47:06.294195 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-11670e45-026a-4133-be2d-464122954742 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] 10.222.0.13 "GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d" status: 200 len: 1260 microversion: 2.1 time: 0.155263 Jun 23 11:47:06.295524 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 221/415] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:47:06 2022] GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:47:06.619643 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-e22cb4f4-384e-4995-b38e-182334483700 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:47:06.620286 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-e22cb4f4-384e-4995-b38e-182334483700 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 6b648e87-b71a-4ef3-aada-f884b8efb154] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:47:06.624905 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-3efc2c47-4876-417a-b328-51344e89f9da tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:47:06.625583 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-3efc2c47-4876-417a-b328-51344e89f9da tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] [instance: a17006fa-d781-4551-a96c-1ca769325ae6] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:47:06.626868 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-e22cb4f4-384e-4995-b38e-182334483700 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:06.627324 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-e22cb4f4-384e-4995-b38e-182334483700 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:06.628089 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-e22cb4f4-384e-4995-b38e-182334483700 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:06.628522 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-e22cb4f4-384e-4995-b38e-182334483700 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:06.632808 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-3efc2c47-4876-417a-b328-51344e89f9da tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:06.632808 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-3efc2c47-4876-417a-b328-51344e89f9da tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:06.633524 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-3efc2c47-4876-417a-b328-51344e89f9da tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:06.634022 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-3efc2c47-4876-417a-b328-51344e89f9da tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:06.829438 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-e22cb4f4-384e-4995-b38e-182334483700 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:47:06.834625 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-3efc2c47-4876-417a-b328-51344e89f9da tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0cc563017646f6acea9127f7f525ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2187f9489844ab8bbf1f69df83b2de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:47:06.837863 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-e22cb4f4-384e-4995-b38e-182334483700 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154" status: 200 len: 1371 microversion: 2.1 time: 0.223105 Jun 23 11:47:06.838443 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 195/416] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:47:06 2022] GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154 => generated 1371 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:47:06.845211 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-3efc2c47-4876-417a-b328-51344e89f9da tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] 10.222.0.13 "GET /compute/v2.1/servers/a17006fa-d781-4551-a96c-1ca769325ae6" status: 200 len: 1319 microversion: 2.1 time: 0.224189 Jun 23 11:47:06.846150 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 222/417] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:47:06 2022] GET /compute/v2.1/servers/a17006fa-d781-4551-a96c-1ca769325ae6 => generated 1319 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:47:07.311524 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-da300642-c1a8-4b6e-b166-9b87f33ea570 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:47:07.312135 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-da300642-c1a8-4b6e-b166-9b87f33ea570 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] [instance: c026366c-311a-45eb-899c-30703cd7eb1d] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:47:07.318265 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-da300642-c1a8-4b6e-b166-9b87f33ea570 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:07.318757 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-da300642-c1a8-4b6e-b166-9b87f33ea570 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:07.319538 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-da300642-c1a8-4b6e-b166-9b87f33ea570 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:07.320426 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-da300642-c1a8-4b6e-b166-9b87f33ea570 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:07.429403 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [req-7dedcb75-5f08-4f69-b9c4-74c29e3a709e req-e443be4a-8072-4287-a825-77ab92b1d846 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c026366c-311a-45eb-899c-30703cd7eb1d", "name": "network-vif-plugged", "status": "completed", "tag": "0d774b3d-b1c7-415f-9da5-0abe6a54a4eb"}]} {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:47:07.441227 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-7dedcb75-5f08-4f69-b9c4-74c29e3a709e req-e443be4a-8072-4287-a825-77ab92b1d846 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:07.441834 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-7dedcb75-5f08-4f69-b9c4-74c29e3a709e req-e443be4a-8072-4287-a825-77ab92b1d846 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:07.455636 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.compute.server_external_events [req-7dedcb75-5f08-4f69-b9c4-74c29e3a709e req-e443be4a-8072-4287-a825-77ab92b1d846 service nova] Creating event network-vif-plugged:0d774b3d-b1c7-415f-9da5-0abe6a54a4eb for instance c026366c-311a-45eb-899c-30703cd7eb1d on hv-cinder-82099 Jun 23 11:47:07.461997 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [req-7dedcb75-5f08-4f69-b9c4-74c29e3a709e req-e443be4a-8072-4287-a825-77ab92b1d846 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037200 Jun 23 11:47:07.462737 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 223/418] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:47:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:47:07.466409 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-da300642-c1a8-4b6e-b166-9b87f33ea570 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626c3dbdc0f1407db82d6988e68e40b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce01d9a78d3f4bb7b101b47548b73037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:47:07.474098 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-da300642-c1a8-4b6e-b166-9b87f33ea570 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] 10.222.0.13 "GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d" status: 200 len: 1260 microversion: 2.1 time: 0.166381 Jun 23 11:47:07.474674 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 196/419] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:47:07 2022] GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:47:07.855587 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-7620a21f-f731-4dd3-bb78-15e8fdb92b52 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:47:07.856441 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-7620a21f-f731-4dd3-bb78-15e8fdb92b52 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 6b648e87-b71a-4ef3-aada-f884b8efb154] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:47:07.862972 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-167be122-2365-4d5d-93f3-f0e31246457d tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:47:07.863627 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-167be122-2365-4d5d-93f3-f0e31246457d tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] [instance: a17006fa-d781-4551-a96c-1ca769325ae6] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:47:07.864135 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-7620a21f-f731-4dd3-bb78-15e8fdb92b52 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:07.864591 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-7620a21f-f731-4dd3-bb78-15e8fdb92b52 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:07.865470 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-7620a21f-f731-4dd3-bb78-15e8fdb92b52 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:07.866367 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-7620a21f-f731-4dd3-bb78-15e8fdb92b52 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:07.871800 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-167be122-2365-4d5d-93f3-f0e31246457d tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:07.872552 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-167be122-2365-4d5d-93f3-f0e31246457d tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:07.880449 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-167be122-2365-4d5d-93f3-f0e31246457d tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:07.880449 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-167be122-2365-4d5d-93f3-f0e31246457d tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:08.081835 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-7620a21f-f731-4dd3-bb78-15e8fdb92b52 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:47:08.090043 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-167be122-2365-4d5d-93f3-f0e31246457d tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0cc563017646f6acea9127f7f525ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2187f9489844ab8bbf1f69df83b2de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:47:08.097823 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-7620a21f-f731-4dd3-bb78-15e8fdb92b52 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154" status: 200 len: 1371 microversion: 2.1 time: 0.246631 Jun 23 11:47:08.098018 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-167be122-2365-4d5d-93f3-f0e31246457d tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] 10.222.0.13 "GET /compute/v2.1/servers/a17006fa-d781-4551-a96c-1ca769325ae6" status: 200 len: 1319 microversion: 2.1 time: 0.239047 Jun 23 11:47:08.098407 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 224/420] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:47:07 2022] GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154 => generated 1371 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:47:08.107115 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 197/421] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:47:07 2022] GET /compute/v2.1/servers/a17006fa-d781-4551-a96c-1ca769325ae6 => generated 1319 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:47:08.490704 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-32e28cff-2407-41a5-9ddc-1e2009c8e201 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:47:08.491317 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-32e28cff-2407-41a5-9ddc-1e2009c8e201 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] [instance: c026366c-311a-45eb-899c-30703cd7eb1d] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:47:08.498329 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-32e28cff-2407-41a5-9ddc-1e2009c8e201 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:08.498798 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-32e28cff-2407-41a5-9ddc-1e2009c8e201 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:08.499566 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-32e28cff-2407-41a5-9ddc-1e2009c8e201 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:08.499999 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-32e28cff-2407-41a5-9ddc-1e2009c8e201 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:08.636630 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-32e28cff-2407-41a5-9ddc-1e2009c8e201 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626c3dbdc0f1407db82d6988e68e40b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce01d9a78d3f4bb7b101b47548b73037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:47:08.644002 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-32e28cff-2407-41a5-9ddc-1e2009c8e201 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] 10.222.0.13 "GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d" status: 200 len: 1260 microversion: 2.1 time: 0.157289 Jun 23 11:47:08.644564 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 225/422] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:47:08 2022] GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:47:09.115035 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-b3d21858-1cd3-4d25-b558-8bf8427df63c tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:47:09.115363 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-ffda46ed-9f65-412b-973b-fbfd5f1e6ce9 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:47:09.115870 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-b3d21858-1cd3-4d25-b558-8bf8427df63c tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] [instance: a17006fa-d781-4551-a96c-1ca769325ae6] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:47:09.116020 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-ffda46ed-9f65-412b-973b-fbfd5f1e6ce9 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 6b648e87-b71a-4ef3-aada-f884b8efb154] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:47:09.123933 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ffda46ed-9f65-412b-973b-fbfd5f1e6ce9 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:09.124362 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ffda46ed-9f65-412b-973b-fbfd5f1e6ce9 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:09.124525 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-b3d21858-1cd3-4d25-b558-8bf8427df63c tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:09.124972 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-b3d21858-1cd3-4d25-b558-8bf8427df63c tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:09.125119 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ffda46ed-9f65-412b-973b-fbfd5f1e6ce9 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:09.125547 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ffda46ed-9f65-412b-973b-fbfd5f1e6ce9 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:09.125729 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-b3d21858-1cd3-4d25-b558-8bf8427df63c tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:09.126163 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-b3d21858-1cd3-4d25-b558-8bf8427df63c tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:09.130344 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_cell1:SELECT=100 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:47:09.323267 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-ffda46ed-9f65-412b-973b-fbfd5f1e6ce9 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:47:09.330120 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-b3d21858-1cd3-4d25-b558-8bf8427df63c tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0cc563017646f6acea9127f7f525ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2187f9489844ab8bbf1f69df83b2de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:47:09.331407 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-ffda46ed-9f65-412b-973b-fbfd5f1e6ce9 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154" status: 200 len: 1371 microversion: 2.1 time: 0.220604 Jun 23 11:47:09.341612 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 198/423] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:47:09 2022] GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154 => generated 1371 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:47:09.347023 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-b3d21858-1cd3-4d25-b558-8bf8427df63c tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] 10.222.0.13 "GET /compute/v2.1/servers/a17006fa-d781-4551-a96c-1ca769325ae6" status: 200 len: 1509 microversion: 2.1 time: 0.236105 Jun 23 11:47:09.347702 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 226/424] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:47:09 2022] GET /compute/v2.1/servers/a17006fa-d781-4551-a96c-1ca769325ae6 => generated 1509 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:47:09.661789 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-4b1bcf2d-1370-4a45-8d46-cae0b8022ec2 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:47:09.662429 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-4b1bcf2d-1370-4a45-8d46-cae0b8022ec2 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] [instance: c026366c-311a-45eb-899c-30703cd7eb1d] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:47:09.668751 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-4b1bcf2d-1370-4a45-8d46-cae0b8022ec2 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:09.669197 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-4b1bcf2d-1370-4a45-8d46-cae0b8022ec2 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:09.669962 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-4b1bcf2d-1370-4a45-8d46-cae0b8022ec2 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:09.670391 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-4b1bcf2d-1370-4a45-8d46-cae0b8022ec2 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:09.806491 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-4b1bcf2d-1370-4a45-8d46-cae0b8022ec2 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626c3dbdc0f1407db82d6988e68e40b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce01d9a78d3f4bb7b101b47548b73037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:47:09.814586 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-4b1bcf2d-1370-4a45-8d46-cae0b8022ec2 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] 10.222.0.13 "GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d" status: 200 len: 1260 microversion: 2.1 time: 0.157906 Jun 23 11:47:09.815151 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 199/425] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:47:09 2022] GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:47:10.349046 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-bf39da52-78d7-4106-916f-0745a996857a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:47:10.349650 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-bf39da52-78d7-4106-916f-0745a996857a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 6b648e87-b71a-4ef3-aada-f884b8efb154] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:47:10.352312 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_cell0:SELECT=24 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:47:10.357575 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-bf39da52-78d7-4106-916f-0745a996857a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:10.358004 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-bf39da52-78d7-4106-916f-0745a996857a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:10.358782 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-bf39da52-78d7-4106-916f-0745a996857a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:10.359263 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-bf39da52-78d7-4106-916f-0745a996857a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:10.495875 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-bf39da52-78d7-4106-916f-0745a996857a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:47:10.504097 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-bf39da52-78d7-4106-916f-0745a996857a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154" status: 200 len: 1371 microversion: 2.1 time: 0.159039 Jun 23 11:47:10.504768 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 227/426] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:47:10 2022] GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154 => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:47:10.832764 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-6aaf6056-05e6-437b-bc4c-959b5bf28169 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:47:10.833475 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-6aaf6056-05e6-437b-bc4c-959b5bf28169 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] [instance: c026366c-311a-45eb-899c-30703cd7eb1d] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:47:10.841201 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-6aaf6056-05e6-437b-bc4c-959b5bf28169 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:10.841650 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-6aaf6056-05e6-437b-bc4c-959b5bf28169 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:10.842415 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-6aaf6056-05e6-437b-bc4c-959b5bf28169 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:10.842878 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-6aaf6056-05e6-437b-bc4c-959b5bf28169 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:10.978825 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-6aaf6056-05e6-437b-bc4c-959b5bf28169 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626c3dbdc0f1407db82d6988e68e40b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce01d9a78d3f4bb7b101b47548b73037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:47:10.986254 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-6aaf6056-05e6-437b-bc4c-959b5bf28169 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] 10.222.0.13 "GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d" status: 200 len: 1260 microversion: 2.1 time: 0.157699 Jun 23 11:47:10.986853 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 200/427] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:47:10 2022] GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:47:11.521945 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-67f9c76a-c6ac-4ea9-b140-2209cb1c1dd7 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:47:11.523876 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-67f9c76a-c6ac-4ea9-b140-2209cb1c1dd7 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 6b648e87-b71a-4ef3-aada-f884b8efb154] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:47:11.533196 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-67f9c76a-c6ac-4ea9-b140-2209cb1c1dd7 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:11.534498 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-67f9c76a-c6ac-4ea9-b140-2209cb1c1dd7 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:11.535913 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-67f9c76a-c6ac-4ea9-b140-2209cb1c1dd7 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:11.536625 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-67f9c76a-c6ac-4ea9-b140-2209cb1c1dd7 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:11.669136 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-67f9c76a-c6ac-4ea9-b140-2209cb1c1dd7 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:47:11.676779 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-67f9c76a-c6ac-4ea9-b140-2209cb1c1dd7 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154" status: 200 len: 1371 microversion: 2.1 time: 0.159567 Jun 23 11:47:11.677336 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 228/428] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:47:11 2022] GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154 => generated 1371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:47:11.735152 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [req-be1a2bb6-bf06-4408-93ad-ddd17cde4de0 req-1dbe66de-a7a0-4b53-baaf-d694d5507002 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b648e87-b71a-4ef3-aada-f884b8efb154", "name": "network-vif-plugged", "status": "completed", "tag": "cae1bf17-0db1-4c4a-8280-5a78b15781a7"}]} {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:47:11.748299 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [req-be1a2bb6-bf06-4408-93ad-ddd17cde4de0 req-1dbe66de-a7a0-4b53-baaf-d694d5507002 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:11.748299 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [req-be1a2bb6-bf06-4408-93ad-ddd17cde4de0 req-1dbe66de-a7a0-4b53-baaf-d694d5507002 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:11.756203 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.compute.server_external_events [req-be1a2bb6-bf06-4408-93ad-ddd17cde4de0 req-1dbe66de-a7a0-4b53-baaf-d694d5507002 service nova] Creating event network-vif-plugged:cae1bf17-0db1-4c4a-8280-5a78b15781a7 for instance 6b648e87-b71a-4ef3-aada-f884b8efb154 on hv-cinder-82099 Jun 23 11:47:11.761781 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [req-be1a2bb6-bf06-4408-93ad-ddd17cde4de0 req-1dbe66de-a7a0-4b53-baaf-d694d5507002 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030529 Jun 23 11:47:11.762422 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 201/429] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:47:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:47:12.003072 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-feb3d625-e6f7-4b32-bfd9-13dc54b6e6d6 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:47:12.003599 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-feb3d625-e6f7-4b32-bfd9-13dc54b6e6d6 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] [instance: c026366c-311a-45eb-899c-30703cd7eb1d] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:47:12.010023 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-feb3d625-e6f7-4b32-bfd9-13dc54b6e6d6 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:12.010466 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-feb3d625-e6f7-4b32-bfd9-13dc54b6e6d6 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:12.011257 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-feb3d625-e6f7-4b32-bfd9-13dc54b6e6d6 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:12.011716 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-feb3d625-e6f7-4b32-bfd9-13dc54b6e6d6 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:12.189563 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-feb3d625-e6f7-4b32-bfd9-13dc54b6e6d6 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626c3dbdc0f1407db82d6988e68e40b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce01d9a78d3f4bb7b101b47548b73037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:47:12.198354 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-feb3d625-e6f7-4b32-bfd9-13dc54b6e6d6 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] 10.222.0.13 "GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d" status: 200 len: 1443 microversion: 2.1 time: 0.199401 Jun 23 11:47:12.198931 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 229/430] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:47:11 2022] GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d => generated 1443 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:47:12.216623 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-03cc04cd-ae44-42cb-881a-2347cccb737f tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:47:12.217320 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-03cc04cd-ae44-42cb-881a-2347cccb737f tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] [instance: c026366c-311a-45eb-899c-30703cd7eb1d] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:47:12.223500 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-03cc04cd-ae44-42cb-881a-2347cccb737f tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:12.223949 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-03cc04cd-ae44-42cb-881a-2347cccb737f tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:12.224727 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-03cc04cd-ae44-42cb-881a-2347cccb737f tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:12.225161 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-03cc04cd-ae44-42cb-881a-2347cccb737f tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:12.229493 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_cell1:SELECT=100 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:47:12.365013 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-03cc04cd-ae44-42cb-881a-2347cccb737f tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626c3dbdc0f1407db82d6988e68e40b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce01d9a78d3f4bb7b101b47548b73037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:47:12.373764 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-03cc04cd-ae44-42cb-881a-2347cccb737f tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] 10.222.0.13 "GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d" status: 200 len: 1443 microversion: 2.1 time: 0.161833 Jun 23 11:47:12.374322 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 202/431] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:47:12 2022] GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d => generated 1443 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:47:12.694109 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-c031fb0c-f82a-4b62-9096-256860ff9352 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:47:12.695344 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-c031fb0c-f82a-4b62-9096-256860ff9352 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 6b648e87-b71a-4ef3-aada-f884b8efb154] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:47:12.701475 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-c031fb0c-f82a-4b62-9096-256860ff9352 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:12.702000 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-c031fb0c-f82a-4b62-9096-256860ff9352 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:12.702791 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-c031fb0c-f82a-4b62-9096-256860ff9352 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:12.703221 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-c031fb0c-f82a-4b62-9096-256860ff9352 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:12.923632 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-c031fb0c-f82a-4b62-9096-256860ff9352 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:47:12.932022 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-c031fb0c-f82a-4b62-9096-256860ff9352 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154" status: 200 len: 1371 microversion: 2.1 time: 0.242064 Jun 23 11:47:12.932554 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 230/432] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:47:12 2022] GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154 => generated 1371 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:47:13.949469 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-c5caf3e0-184c-4246-84be-f41731740067 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:47:13.950093 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-c5caf3e0-184c-4246-84be-f41731740067 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 6b648e87-b71a-4ef3-aada-f884b8efb154] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:47:13.957666 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c5caf3e0-184c-4246-84be-f41731740067 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:13.958326 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c5caf3e0-184c-4246-84be-f41731740067 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:13.959640 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c5caf3e0-184c-4246-84be-f41731740067 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:13.960756 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c5caf3e0-184c-4246-84be-f41731740067 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:14.174384 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-c5caf3e0-184c-4246-84be-f41731740067 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:47:14.182358 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-c5caf3e0-184c-4246-84be-f41731740067 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154" status: 200 len: 1371 microversion: 2.1 time: 0.237122 Jun 23 11:47:14.183178 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 203/433] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:47:13 2022] GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154 => generated 1371 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:47:15.199580 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-92ca5114-6f95-4bd1-8683-94f7ee8b357f tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:47:15.200195 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-92ca5114-6f95-4bd1-8683-94f7ee8b357f tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 6b648e87-b71a-4ef3-aada-f884b8efb154] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:47:15.207183 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-92ca5114-6f95-4bd1-8683-94f7ee8b357f tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:15.207880 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-92ca5114-6f95-4bd1-8683-94f7ee8b357f tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:15.209521 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-92ca5114-6f95-4bd1-8683-94f7ee8b357f tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:15.210127 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-92ca5114-6f95-4bd1-8683-94f7ee8b357f tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:15.220716 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [req-3ed62701-d86b-4ec6-9676-032907cee4e0 req-d494e76c-ad3b-488b-b7f2-1339a8a12ec9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c026366c-311a-45eb-899c-30703cd7eb1d", "tag": "0d774b3d-b1c7-415f-9da5-0abe6a54a4eb"}]} {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:47:15.230132 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [req-3ed62701-d86b-4ec6-9676-032907cee4e0 req-d494e76c-ad3b-488b-b7f2-1339a8a12ec9 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:15.230973 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [req-3ed62701-d86b-4ec6-9676-032907cee4e0 req-d494e76c-ad3b-488b-b7f2-1339a8a12ec9 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:15.243378 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.compute.server_external_events [req-3ed62701-d86b-4ec6-9676-032907cee4e0 req-d494e76c-ad3b-488b-b7f2-1339a8a12ec9 service nova] Creating event network-changed:0d774b3d-b1c7-415f-9da5-0abe6a54a4eb for instance c026366c-311a-45eb-899c-30703cd7eb1d on hv-cinder-82099 Jun 23 11:47:15.249131 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [req-3ed62701-d86b-4ec6-9676-032907cee4e0 req-d494e76c-ad3b-488b-b7f2-1339a8a12ec9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032272 Jun 23 11:47:15.250375 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 204/434] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:47:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:47:15.449256 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-92ca5114-6f95-4bd1-8683-94f7ee8b357f tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:47:15.457557 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-92ca5114-6f95-4bd1-8683-94f7ee8b357f tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154" status: 200 len: 1564 microversion: 2.1 time: 0.261941 Jun 23 11:47:15.458438 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 231/435] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:47:15 2022] GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154 => generated 1564 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:47:15.476511 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-1fcdeb76-3d47-4dd3-97f8-31423661b179 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:47:15.477112 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-1fcdeb76-3d47-4dd3-97f8-31423661b179 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 6b648e87-b71a-4ef3-aada-f884b8efb154] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:47:15.483708 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-1fcdeb76-3d47-4dd3-97f8-31423661b179 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:15.484367 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-1fcdeb76-3d47-4dd3-97f8-31423661b179 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:15.485320 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-1fcdeb76-3d47-4dd3-97f8-31423661b179 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:15.486017 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-1fcdeb76-3d47-4dd3-97f8-31423661b179 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:15.592473 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-1fcdeb76-3d47-4dd3-97f8-31423661b179 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.121828 Jun 23 11:47:15.593069 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 205/436] 10.222.0.13 () {58 vars in 1274 bytes} [Thu Jun 23 11:47:15 2022] GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154/os-interface => generated 284 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:47:16.862807 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [req-3150b9bb-0028-4a59-88ea-d7cb23b113f5 req-bf0968b8-1d31-498e-888f-13461f6e8587 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b648e87-b71a-4ef3-aada-f884b8efb154", "tag": "cae1bf17-0db1-4c4a-8280-5a78b15781a7"}]} {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:47:16.872807 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-3150b9bb-0028-4a59-88ea-d7cb23b113f5 req-bf0968b8-1d31-498e-888f-13461f6e8587 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:16.874170 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-3150b9bb-0028-4a59-88ea-d7cb23b113f5 req-bf0968b8-1d31-498e-888f-13461f6e8587 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:16.889345 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.compute.server_external_events [req-3150b9bb-0028-4a59-88ea-d7cb23b113f5 req-bf0968b8-1d31-498e-888f-13461f6e8587 service nova] Creating event network-changed:cae1bf17-0db1-4c4a-8280-5a78b15781a7 for instance 6b648e87-b71a-4ef3-aada-f884b8efb154 on hv-cinder-82099 Jun 23 11:47:16.894591 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [req-3150b9bb-0028-4a59-88ea-d7cb23b113f5 req-bf0968b8-1d31-498e-888f-13461f6e8587 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035285 Jun 23 11:47:16.895201 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 232/437] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:47:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:47:35.461419 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_api:SELECT=23 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:47:35.462152 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_cell1:SELECT=17 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:47:35.466097 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-41d308cc-5ebd-433e-848d-86044cc2c07a tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-309377032", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-367548420", "security_groups": [{"name": "tempest-secgroup-smoke-1542660815"}], "block_device_mapping_v2": [{"uuid": "a70c2e27-45af-4f45-9da7-8b11ecbefe99", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "24cad3d6-9999-4d1e-ad9b-006e17356f41"}]}} {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:47:35.580664 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.network.neutron [None req-41d308cc-5ebd-433e-848d-86044cc2c07a tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] validate_networks() for [('24cad3d6-9999-4d1e-ad9b-006e17356f41', None, None, None, None, None)] {{(pid=124669) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 11:47:35.943698 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.virt.hardware [None req-41d308cc-5ebd-433e-848d-86044cc2c07a tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Flavor limits 0:0:0 {{(pid=124669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 11:47:35.944115 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.virt.hardware [None req-41d308cc-5ebd-433e-848d-86044cc2c07a tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Image limits 0:0:0 {{(pid=124669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 11:47:35.944577 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.virt.hardware [None req-41d308cc-5ebd-433e-848d-86044cc2c07a tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Flavor pref 0:0:0 {{(pid=124669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 11:47:35.944975 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.virt.hardware [None req-41d308cc-5ebd-433e-848d-86044cc2c07a tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Image pref 0:0:0 {{(pid=124669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 11:47:35.945403 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.virt.hardware [None req-41d308cc-5ebd-433e-848d-86044cc2c07a tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 11:47:35.954724 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-41d308cc-5ebd-433e-848d-86044cc2c07a tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:35.955167 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-41d308cc-5ebd-433e-848d-86044cc2c07a tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:35.955948 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-41d308cc-5ebd-433e-848d-86044cc2c07a tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:35.956380 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-41d308cc-5ebd-433e-848d-86044cc2c07a tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:35.974133 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.quota [None req-41d308cc-5ebd-433e-848d-86044cc2c07a tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Getting quotas for project 2e810a9bc3b44c4aa8ca2ddd0fa68f7b. Resources: {'cores', 'instances', 'ram'} {{(pid=124669) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:47:35.978061 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.quota [None req-41d308cc-5ebd-433e-848d-86044cc2c07a tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Getting quotas for user 6cc5a4676f6a416cbdc8c67ebd80cdf3 and project 2e810a9bc3b44c4aa8ca2ddd0fa68f7b. Resources: {'cores', 'instances', 'ram'} {{(pid=124669) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:47:36.036148 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-41d308cc-5ebd-433e-848d-86044cc2c07a tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Going to run 1 instances... {{(pid=124669) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 11:47:36.038268 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-41d308cc-5ebd-433e-848d-86044cc2c07a tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] [instance: 230c27ca-dfe2-4a74-aca7-106c1e5af8fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a70c2e27-45af-4f45-9da7-8b11ecbefe99',volume_size=None,volume_type=None)] {{(pid=124669) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 11:47:36.498859 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-41d308cc-5ebd-433e-848d-86044cc2c07a tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.039363 Jun 23 11:47:36.500831 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 206/438] 10.222.0.13 () {60 vars in 1146 bytes} [Thu Jun 23 11:47:35 2022] POST /compute/v2.1/servers => generated 406 bytes in 1041 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 11:47:36.508381 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=1 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:47:36.509131 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_cell1:SELECT=37 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:47:36.513801 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-c20437d6-273e-40f1-b4dc-1c3d3f7bc1d1 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:47:36.514511 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-c20437d6-273e-40f1-b4dc-1c3d3f7bc1d1 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] [instance: 230c27ca-dfe2-4a74-aca7-106c1e5af8fc] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:47:36.568429 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-c20437d6-273e-40f1-b4dc-1c3d3f7bc1d1 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc5a4676f6a416cbdc8c67ebd80cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e810a9bc3b44c4aa8ca2ddd0fa68f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:47:36.575047 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-c20437d6-273e-40f1-b4dc-1c3d3f7bc1d1 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] 10.222.0.13 "GET /compute/v2.1/servers/230c27ca-dfe2-4a74-aca7-106c1e5af8fc" status: 200 len: 1093 microversion: 2.1 time: 0.067841 Jun 23 11:47:36.576107 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 233/439] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:47:36 2022] GET /compute/v2.1/servers/230c27ca-dfe2-4a74-aca7-106c1e5af8fc => generated 1093 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:47:37.547658 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-68a2bf3d-8dfb-4db8-a09a-545f56f768cd tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:47:37.548214 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-68a2bf3d-8dfb-4db8-a09a-545f56f768cd tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 250e2ce6-70ad-4082-8073-6a9cea0ca1e4] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:47:37.557409 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-68a2bf3d-8dfb-4db8-a09a-545f56f768cd tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:37.557409 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-68a2bf3d-8dfb-4db8-a09a-545f56f768cd tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:37.557688 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-68a2bf3d-8dfb-4db8-a09a-545f56f768cd tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:37.558255 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-68a2bf3d-8dfb-4db8-a09a-545f56f768cd tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:37.582168 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-68a2bf3d-8dfb-4db8-a09a-545f56f768cd tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4/ips" status: 200 len: 149 microversion: 2.1 time: 0.039384 Jun 23 11:47:37.586158 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 207/440] 10.222.0.13 () {58 vars in 1247 bytes} [Thu Jun 23 11:47:37 2022] GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:47:37.593707 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-9770cafa-92c3-4120-b400-ef7cd3bf8045 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:47:37.594343 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-9770cafa-92c3-4120-b400-ef7cd3bf8045 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] [instance: 230c27ca-dfe2-4a74-aca7-106c1e5af8fc] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:47:37.601379 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-9770cafa-92c3-4120-b400-ef7cd3bf8045 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:37.601826 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-9770cafa-92c3-4120-b400-ef7cd3bf8045 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:37.602614 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-9770cafa-92c3-4120-b400-ef7cd3bf8045 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:37.603053 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-9770cafa-92c3-4120-b400-ef7cd3bf8045 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:37.667414 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-9770cafa-92c3-4120-b400-ef7cd3bf8045 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc5a4676f6a416cbdc8c67ebd80cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e810a9bc3b44c4aa8ca2ddd0fa68f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:47:37.677180 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-9770cafa-92c3-4120-b400-ef7cd3bf8045 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] 10.222.0.13 "GET /compute/v2.1/servers/230c27ca-dfe2-4a74-aca7-106c1e5af8fc" status: 200 len: 1143 microversion: 2.1 time: 0.088091 Jun 23 11:47:37.677853 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 234/441] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:47:37 2022] GET /compute/v2.1/servers/230c27ca-dfe2-4a74-aca7-106c1e5af8fc => generated 1143 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:47:38.694961 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-3a6d4c60-2ff1-4fb6-b99f-7e26972f50e0 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:47:38.695708 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-3a6d4c60-2ff1-4fb6-b99f-7e26972f50e0 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] [instance: 230c27ca-dfe2-4a74-aca7-106c1e5af8fc] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:47:38.702783 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-3a6d4c60-2ff1-4fb6-b99f-7e26972f50e0 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:38.703230 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-3a6d4c60-2ff1-4fb6-b99f-7e26972f50e0 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:38.703981 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-3a6d4c60-2ff1-4fb6-b99f-7e26972f50e0 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:38.704412 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-3a6d4c60-2ff1-4fb6-b99f-7e26972f50e0 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:38.766042 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-3a6d4c60-2ff1-4fb6-b99f-7e26972f50e0 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc5a4676f6a416cbdc8c67ebd80cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e810a9bc3b44c4aa8ca2ddd0fa68f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:47:38.773358 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-3a6d4c60-2ff1-4fb6-b99f-7e26972f50e0 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] 10.222.0.13 "GET /compute/v2.1/servers/230c27ca-dfe2-4a74-aca7-106c1e5af8fc" status: 200 len: 1191 microversion: 2.1 time: 0.082330 Jun 23 11:47:38.773911 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 208/442] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:47:38 2022] GET /compute/v2.1/servers/230c27ca-dfe2-4a74-aca7-106c1e5af8fc => generated 1191 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:47:39.790701 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-b74db69a-fe5d-4ddd-b73f-5060b8a3a62c tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:47:39.791355 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-b74db69a-fe5d-4ddd-b73f-5060b8a3a62c tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] [instance: 230c27ca-dfe2-4a74-aca7-106c1e5af8fc] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:47:39.797361 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-b74db69a-fe5d-4ddd-b73f-5060b8a3a62c tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:39.797804 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-b74db69a-fe5d-4ddd-b73f-5060b8a3a62c tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:39.798575 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-b74db69a-fe5d-4ddd-b73f-5060b8a3a62c tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:39.799008 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-b74db69a-fe5d-4ddd-b73f-5060b8a3a62c tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:40.255905 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-b74db69a-fe5d-4ddd-b73f-5060b8a3a62c tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc5a4676f6a416cbdc8c67ebd80cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e810a9bc3b44c4aa8ca2ddd0fa68f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:47:40.263553 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-b74db69a-fe5d-4ddd-b73f-5060b8a3a62c tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] 10.222.0.13 "GET /compute/v2.1/servers/230c27ca-dfe2-4a74-aca7-106c1e5af8fc" status: 200 len: 1277 microversion: 2.1 time: 0.476832 Jun 23 11:47:40.264145 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 235/443] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:47:39 2022] GET /compute/v2.1/servers/230c27ca-dfe2-4a74-aca7-106c1e5af8fc => generated 1277 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:47:40.335535 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-4d3b21c5-7ca4-4093-b711-bf6c0d29af36 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dd5302c9-15df-4e97-98eb-70965c9010f1"}} {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:47:40.336754 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-4d3b21c5-7ca4-4093-b711-bf6c0d29af36 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 250e2ce6-70ad-4082-8073-6a9cea0ca1e4] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:47:40.343747 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-4d3b21c5-7ca4-4093-b711-bf6c0d29af36 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:40.343978 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-4d3b21c5-7ca4-4093-b711-bf6c0d29af36 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:40.344739 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-4d3b21c5-7ca4-4093-b711-bf6c0d29af36 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:40.345168 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-4d3b21c5-7ca4-4093-b711-bf6c0d29af36 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:41.090410 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-4d3b21c5-7ca4-4093-b711-bf6c0d29af36 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "POST /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.758998 Jun 23 11:47:41.091003 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 209/444] 10.222.0.13 () {60 vars in 1322 bytes} [Thu Jun 23 11:47:40 2022] POST /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4/os-volume_attachments => generated 194 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:47:41.144586 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [req-298b25c1-d06d-49f4-b42b-5ed6cb8e9090 req-bac57e6e-7fa4-4d77-900d-10ba5a95c334 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "230c27ca-dfe2-4a74-aca7-106c1e5af8fc", "tag": "22ef1251-f87b-4a4f-9c86-55c2036a4cdc"}]} {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:47:41.153905 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-298b25c1-d06d-49f4-b42b-5ed6cb8e9090 req-bac57e6e-7fa4-4d77-900d-10ba5a95c334 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:41.160268 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-298b25c1-d06d-49f4-b42b-5ed6cb8e9090 req-bac57e6e-7fa4-4d77-900d-10ba5a95c334 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:41.172113 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.compute.server_external_events [req-298b25c1-d06d-49f4-b42b-5ed6cb8e9090 req-bac57e6e-7fa4-4d77-900d-10ba5a95c334 service nova] Creating event network-changed:22ef1251-f87b-4a4f-9c86-55c2036a4cdc for instance 230c27ca-dfe2-4a74-aca7-106c1e5af8fc on hv-cinder-82099 Jun 23 11:47:41.177471 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [req-298b25c1-d06d-49f4-b42b-5ed6cb8e9090 req-bac57e6e-7fa4-4d77-900d-10ba5a95c334 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039239 Jun 23 11:47:41.178221 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 236/445] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:47:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:47:41.285571 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-fbf1dd52-6e91-4eae-8444-2977760ca926 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:47:41.286608 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-fbf1dd52-6e91-4eae-8444-2977760ca926 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] [instance: 230c27ca-dfe2-4a74-aca7-106c1e5af8fc] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:47:41.295710 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-fbf1dd52-6e91-4eae-8444-2977760ca926 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:41.296736 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-fbf1dd52-6e91-4eae-8444-2977760ca926 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:41.297746 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-fbf1dd52-6e91-4eae-8444-2977760ca926 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:41.298383 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-fbf1dd52-6e91-4eae-8444-2977760ca926 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:41.520623 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-fbf1dd52-6e91-4eae-8444-2977760ca926 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc5a4676f6a416cbdc8c67ebd80cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e810a9bc3b44c4aa8ca2ddd0fa68f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:47:41.528087 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-fbf1dd52-6e91-4eae-8444-2977760ca926 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] 10.222.0.13 "GET /compute/v2.1/servers/230c27ca-dfe2-4a74-aca7-106c1e5af8fc" status: 200 len: 1265 microversion: 2.1 time: 0.250275 Jun 23 11:47:41.529541 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 210/446] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:47:41 2022] GET /compute/v2.1/servers/230c27ca-dfe2-4a74-aca7-106c1e5af8fc => generated 1265 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:47:42.552369 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-808b0ec4-1831-4840-9ea5-3a81c89bd830 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:47:42.553064 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-808b0ec4-1831-4840-9ea5-3a81c89bd830 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] [instance: 230c27ca-dfe2-4a74-aca7-106c1e5af8fc] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:47:42.559216 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-808b0ec4-1831-4840-9ea5-3a81c89bd830 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:42.559661 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-808b0ec4-1831-4840-9ea5-3a81c89bd830 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:42.561040 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-808b0ec4-1831-4840-9ea5-3a81c89bd830 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:42.561575 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-808b0ec4-1831-4840-9ea5-3a81c89bd830 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:42.651514 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-92cbdde9-9085-49b9-906f-01a7920bfb57 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "07cde5ac-aa14-43b0-98dc-74febcdeecd6", "device": "/dev/sdb"}} {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:47:42.653127 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-92cbdde9-9085-49b9-906f-01a7920bfb57 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] [instance: a17006fa-d781-4551-a96c-1ca769325ae6] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:47:42.660049 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-92cbdde9-9085-49b9-906f-01a7920bfb57 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:42.660547 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-92cbdde9-9085-49b9-906f-01a7920bfb57 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:42.661349 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-92cbdde9-9085-49b9-906f-01a7920bfb57 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:42.661790 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-92cbdde9-9085-49b9-906f-01a7920bfb57 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:42.707689 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-808b0ec4-1831-4840-9ea5-3a81c89bd830 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc5a4676f6a416cbdc8c67ebd80cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e810a9bc3b44c4aa8ca2ddd0fa68f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:47:42.721546 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-808b0ec4-1831-4840-9ea5-3a81c89bd830 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] 10.222.0.13 "GET /compute/v2.1/servers/230c27ca-dfe2-4a74-aca7-106c1e5af8fc" status: 200 len: 1265 microversion: 2.1 time: 0.175297 Jun 23 11:47:42.722129 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 237/447] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:47:42 2022] GET /compute/v2.1/servers/230c27ca-dfe2-4a74-aca7-106c1e5af8fc => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:47:43.738512 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-cc4fdf16-18f3-4969-8df6-30fac0417215 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:47:43.739169 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-cc4fdf16-18f3-4969-8df6-30fac0417215 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] [instance: 230c27ca-dfe2-4a74-aca7-106c1e5af8fc] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:47:43.745189 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-cc4fdf16-18f3-4969-8df6-30fac0417215 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:43.745641 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-cc4fdf16-18f3-4969-8df6-30fac0417215 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:43.746396 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-cc4fdf16-18f3-4969-8df6-30fac0417215 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:43.746847 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-cc4fdf16-18f3-4969-8df6-30fac0417215 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:43.867407 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-92cbdde9-9085-49b9-906f-01a7920bfb57 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] 10.222.0.13 "POST /compute/v2.1/servers/a17006fa-d781-4551-a96c-1ca769325ae6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.219469 Jun 23 11:47:43.868396 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 211/448] 10.222.0.13 () {60 vars in 1322 bytes} [Thu Jun 23 11:47:42 2022] POST /compute/v2.1/servers/a17006fa-d781-4551-a96c-1ca769325ae6/os-volume_attachments => generated 194 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:47:43.882794 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-cc4fdf16-18f3-4969-8df6-30fac0417215 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc5a4676f6a416cbdc8c67ebd80cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e810a9bc3b44c4aa8ca2ddd0fa68f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:47:43.891730 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-cc4fdf16-18f3-4969-8df6-30fac0417215 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] 10.222.0.13 "GET /compute/v2.1/servers/230c27ca-dfe2-4a74-aca7-106c1e5af8fc" status: 200 len: 1265 microversion: 2.1 time: 0.157074 Jun 23 11:47:43.892298 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 238/449] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:47:43 2022] GET /compute/v2.1/servers/230c27ca-dfe2-4a74-aca7-106c1e5af8fc => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:47:44.909712 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-82e2f1ca-a7cc-4c49-af98-39d6d429bc4e tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:47:44.910329 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-82e2f1ca-a7cc-4c49-af98-39d6d429bc4e tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] [instance: 230c27ca-dfe2-4a74-aca7-106c1e5af8fc] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:47:44.917105 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-82e2f1ca-a7cc-4c49-af98-39d6d429bc4e tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:44.917552 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-82e2f1ca-a7cc-4c49-af98-39d6d429bc4e tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:44.918301 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-82e2f1ca-a7cc-4c49-af98-39d6d429bc4e tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:44.918758 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-82e2f1ca-a7cc-4c49-af98-39d6d429bc4e tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:45.052726 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-82e2f1ca-a7cc-4c49-af98-39d6d429bc4e tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc5a4676f6a416cbdc8c67ebd80cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e810a9bc3b44c4aa8ca2ddd0fa68f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:47:45.060643 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-82e2f1ca-a7cc-4c49-af98-39d6d429bc4e tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] 10.222.0.13 "GET /compute/v2.1/servers/230c27ca-dfe2-4a74-aca7-106c1e5af8fc" status: 200 len: 1265 microversion: 2.1 time: 0.155369 Jun 23 11:47:45.061184 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 212/450] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:47:44 2022] GET /compute/v2.1/servers/230c27ca-dfe2-4a74-aca7-106c1e5af8fc => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:47:46.077326 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-a42c373b-a1cd-43b9-933b-e657dba030e8 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:47:46.077939 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-a42c373b-a1cd-43b9-933b-e657dba030e8 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] [instance: 230c27ca-dfe2-4a74-aca7-106c1e5af8fc] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:47:46.083966 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a42c373b-a1cd-43b9-933b-e657dba030e8 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:46.084416 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a42c373b-a1cd-43b9-933b-e657dba030e8 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:46.085182 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a42c373b-a1cd-43b9-933b-e657dba030e8 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:46.085873 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a42c373b-a1cd-43b9-933b-e657dba030e8 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:46.219578 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-a42c373b-a1cd-43b9-933b-e657dba030e8 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc5a4676f6a416cbdc8c67ebd80cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e810a9bc3b44c4aa8ca2ddd0fa68f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:47:46.226975 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-a42c373b-a1cd-43b9-933b-e657dba030e8 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] 10.222.0.13 "GET /compute/v2.1/servers/230c27ca-dfe2-4a74-aca7-106c1e5af8fc" status: 200 len: 1265 microversion: 2.1 time: 0.153744 Jun 23 11:47:46.227532 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 239/451] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:47:46 2022] GET /compute/v2.1/servers/230c27ca-dfe2-4a74-aca7-106c1e5af8fc => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:47:47.244078 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-084d7339-624f-42f9-bea1-8d56ec5a984d tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:47:47.244706 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-084d7339-624f-42f9-bea1-8d56ec5a984d tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] [instance: 230c27ca-dfe2-4a74-aca7-106c1e5af8fc] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:47:47.247161 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_cell0:SELECT=2 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:47:47.247842 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_cell0:SELECT=6 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:47:47.252852 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-084d7339-624f-42f9-bea1-8d56ec5a984d tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:47.255512 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-084d7339-624f-42f9-bea1-8d56ec5a984d tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:47.255512 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-084d7339-624f-42f9-bea1-8d56ec5a984d tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:47.255512 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-084d7339-624f-42f9-bea1-8d56ec5a984d tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:47.385626 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-084d7339-624f-42f9-bea1-8d56ec5a984d tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc5a4676f6a416cbdc8c67ebd80cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e810a9bc3b44c4aa8ca2ddd0fa68f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:47:47.393576 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-084d7339-624f-42f9-bea1-8d56ec5a984d tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] 10.222.0.13 "GET /compute/v2.1/servers/230c27ca-dfe2-4a74-aca7-106c1e5af8fc" status: 200 len: 1265 microversion: 2.1 time: 0.153493 Jun 23 11:47:47.394126 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 213/452] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:47:47 2022] GET /compute/v2.1/servers/230c27ca-dfe2-4a74-aca7-106c1e5af8fc => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:47:48.410737 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-8864eb0a-f6b7-49ae-bbb1-7a0b44815eb1 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:47:48.412160 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-8864eb0a-f6b7-49ae-bbb1-7a0b44815eb1 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] [instance: 230c27ca-dfe2-4a74-aca7-106c1e5af8fc] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:47:48.413506 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_cell0:SELECT=2 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:47:48.418272 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-8864eb0a-f6b7-49ae-bbb1-7a0b44815eb1 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:48.418757 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-8864eb0a-f6b7-49ae-bbb1-7a0b44815eb1 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:48.419511 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-8864eb0a-f6b7-49ae-bbb1-7a0b44815eb1 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:48.420663 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-8864eb0a-f6b7-49ae-bbb1-7a0b44815eb1 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:48.551645 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-8864eb0a-f6b7-49ae-bbb1-7a0b44815eb1 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc5a4676f6a416cbdc8c67ebd80cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e810a9bc3b44c4aa8ca2ddd0fa68f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:47:48.559306 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-8864eb0a-f6b7-49ae-bbb1-7a0b44815eb1 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] 10.222.0.13 "GET /compute/v2.1/servers/230c27ca-dfe2-4a74-aca7-106c1e5af8fc" status: 200 len: 1265 microversion: 2.1 time: 0.152512 Jun 23 11:47:48.559862 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 240/453] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:47:48 2022] GET /compute/v2.1/servers/230c27ca-dfe2-4a74-aca7-106c1e5af8fc => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:47:49.575747 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-827d77ca-13c9-4063-ab3f-8f6985286328 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:47:49.576386 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-827d77ca-13c9-4063-ab3f-8f6985286328 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] [instance: 230c27ca-dfe2-4a74-aca7-106c1e5af8fc] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:47:49.582597 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-827d77ca-13c9-4063-ab3f-8f6985286328 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:49.586214 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-827d77ca-13c9-4063-ab3f-8f6985286328 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:49.586214 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-827d77ca-13c9-4063-ab3f-8f6985286328 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:49.586214 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-827d77ca-13c9-4063-ab3f-8f6985286328 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:49.717706 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-827d77ca-13c9-4063-ab3f-8f6985286328 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc5a4676f6a416cbdc8c67ebd80cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e810a9bc3b44c4aa8ca2ddd0fa68f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:47:49.725226 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-827d77ca-13c9-4063-ab3f-8f6985286328 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] 10.222.0.13 "GET /compute/v2.1/servers/230c27ca-dfe2-4a74-aca7-106c1e5af8fc" status: 200 len: 1265 microversion: 2.1 time: 0.153223 Jun 23 11:47:49.725790 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 214/454] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:47:49 2022] GET /compute/v2.1/servers/230c27ca-dfe2-4a74-aca7-106c1e5af8fc => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:47:50.743049 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-87b98e22-2026-4498-9cef-f3139cef4333 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:47:50.743568 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-87b98e22-2026-4498-9cef-f3139cef4333 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] [instance: 230c27ca-dfe2-4a74-aca7-106c1e5af8fc] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:47:50.750517 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-87b98e22-2026-4498-9cef-f3139cef4333 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:50.750990 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-87b98e22-2026-4498-9cef-f3139cef4333 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:50.751751 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-87b98e22-2026-4498-9cef-f3139cef4333 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:50.752184 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-87b98e22-2026-4498-9cef-f3139cef4333 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:50.887216 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-87b98e22-2026-4498-9cef-f3139cef4333 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc5a4676f6a416cbdc8c67ebd80cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e810a9bc3b44c4aa8ca2ddd0fa68f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:47:50.894593 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-87b98e22-2026-4498-9cef-f3139cef4333 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] 10.222.0.13 "GET /compute/v2.1/servers/230c27ca-dfe2-4a74-aca7-106c1e5af8fc" status: 200 len: 1265 microversion: 2.1 time: 0.155460 Jun 23 11:47:50.895163 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 241/455] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:47:50 2022] GET /compute/v2.1/servers/230c27ca-dfe2-4a74-aca7-106c1e5af8fc => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:47:51.763130 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-7a47f252-2a4a-42c2-8071-2265de41836a tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Action: 'create', calling method: .version_select at 0x7f5d06fa8160>, body: {"keypair": {"name": "tempest-keypair-1392421927", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFuVyWyB/o7zzmvjYB/dG4NDSeajRC9VSBjtEDPmHpCc/cauqS5wxX/U0/pz9IMZ9bKA8UZEhq0QZZ/NeE2114zsDq1Ov84Aaie6Z8avYWy9dzaehJQY1zmExYXVYV39sw=="}} {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:47:51.784031 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.quota [None req-7a47f252-2a4a-42c2-8071-2265de41836a tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Getting quotas for project ee135767dfc846469d64b658372994a8. Resources: {'key_pairs'} {{(pid=124669) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:47:51.788006 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.quota [None req-7a47f252-2a4a-42c2-8071-2265de41836a tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Getting quotas for user b7fd8323d29d445f903e2103453e8ae6 and project ee135767dfc846469d64b658372994a8. Resources: {'key_pairs'} {{(pid=124669) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:47:51.905113 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-7a47f252-2a4a-42c2-8071-2265de41836a tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.145650 Jun 23 11:47:51.905849 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 215/456] 10.222.0.13 () {60 vars in 1158 bytes} [Thu Jun 23 11:47:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:47:51.913508 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-3a2d8975-3a59-4689-82f4-ce03c21b52a2 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:47:51.913508 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-3a2d8975-3a59-4689-82f4-ce03c21b52a2 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] [instance: 230c27ca-dfe2-4a74-aca7-106c1e5af8fc] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:47:51.917781 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-3a2d8975-3a59-4689-82f4-ce03c21b52a2 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:51.918243 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-3a2d8975-3a59-4689-82f4-ce03c21b52a2 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:51.919033 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-3a2d8975-3a59-4689-82f4-ce03c21b52a2 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:51.919471 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-3a2d8975-3a59-4689-82f4-ce03c21b52a2 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:52.083686 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-3a2d8975-3a59-4689-82f4-ce03c21b52a2 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc5a4676f6a416cbdc8c67ebd80cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e810a9bc3b44c4aa8ca2ddd0fa68f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:47:52.091579 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-3a2d8975-3a59-4689-82f4-ce03c21b52a2 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] 10.222.0.13 "GET /compute/v2.1/servers/230c27ca-dfe2-4a74-aca7-106c1e5af8fc" status: 200 len: 1265 microversion: 2.1 time: 0.184370 Jun 23 11:47:52.095744 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 242/457] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:47:51 2022] GET /compute/v2.1/servers/230c27ca-dfe2-4a74-aca7-106c1e5af8fc => generated 1265 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:47:53.110265 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-36c967b1-0cc0-4686-95fd-b2ecede0c5d3 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:47:53.110830 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-36c967b1-0cc0-4686-95fd-b2ecede0c5d3 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] [instance: 230c27ca-dfe2-4a74-aca7-106c1e5af8fc] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:47:53.116980 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-36c967b1-0cc0-4686-95fd-b2ecede0c5d3 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:53.117429 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-36c967b1-0cc0-4686-95fd-b2ecede0c5d3 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:53.118189 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-36c967b1-0cc0-4686-95fd-b2ecede0c5d3 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:53.118654 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-36c967b1-0cc0-4686-95fd-b2ecede0c5d3 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:53.257523 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-36c967b1-0cc0-4686-95fd-b2ecede0c5d3 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc5a4676f6a416cbdc8c67ebd80cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e810a9bc3b44c4aa8ca2ddd0fa68f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:47:53.262051 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-36c967b1-0cc0-4686-95fd-b2ecede0c5d3 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] 10.222.0.13 "GET /compute/v2.1/servers/230c27ca-dfe2-4a74-aca7-106c1e5af8fc" status: 200 len: 1265 microversion: 2.1 time: 0.157300 Jun 23 11:47:53.262635 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 216/458] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:47:53 2022] GET /compute/v2.1/servers/230c27ca-dfe2-4a74-aca7-106c1e5af8fc => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:47:53.960506 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [req-cc5fda17-2f14-489d-a95e-b3d2a4a1ba3b req-d5769c83-8c7a-4299-9a1b-3b15d26d9d81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "230c27ca-dfe2-4a74-aca7-106c1e5af8fc", "name": "network-vif-plugged", "status": "completed", "tag": "22ef1251-f87b-4a4f-9c86-55c2036a4cdc"}]} {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:47:53.971320 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-cc5fda17-2f14-489d-a95e-b3d2a4a1ba3b req-d5769c83-8c7a-4299-9a1b-3b15d26d9d81 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:53.971758 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-cc5fda17-2f14-489d-a95e-b3d2a4a1ba3b req-d5769c83-8c7a-4299-9a1b-3b15d26d9d81 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:53.983336 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.compute.server_external_events [req-cc5fda17-2f14-489d-a95e-b3d2a4a1ba3b req-d5769c83-8c7a-4299-9a1b-3b15d26d9d81 service nova] Creating event network-vif-plugged:22ef1251-f87b-4a4f-9c86-55c2036a4cdc for instance 230c27ca-dfe2-4a74-aca7-106c1e5af8fc on hv-cinder-82099 Jun 23 11:47:53.988292 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [req-cc5fda17-2f14-489d-a95e-b3d2a4a1ba3b req-d5769c83-8c7a-4299-9a1b-3b15d26d9d81 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033587 Jun 23 11:47:53.988858 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 243/459] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:47:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:47:54.153912 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-fcf6c16b-2673-4f51-b6ed-8f5acaf99d9c tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1575129316", "imageRef": "b19d6f23-214c-4432-bee6-455978023759", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1be91f97-511d-47dc-890a-297123afd9f6"}], "security_groups": [{"name": "tempest-securitygroup--80743617"}], "key_name": "tempest-keypair-1392421927", "user_data": "}} {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:47:54.260108 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.network.neutron [None req-fcf6c16b-2673-4f51-b6ed-8f5acaf99d9c tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] validate_networks() for [('1be91f97-511d-47dc-890a-297123afd9f6', None, None, None, None, None)] {{(pid=124669) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 11:47:54.279069 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-993c4ae9-68c3-4445-95bc-84f6b3c60667 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:47:54.280516 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-993c4ae9-68c3-4445-95bc-84f6b3c60667 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] [instance: 230c27ca-dfe2-4a74-aca7-106c1e5af8fc] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:47:54.286956 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-993c4ae9-68c3-4445-95bc-84f6b3c60667 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:54.287448 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-993c4ae9-68c3-4445-95bc-84f6b3c60667 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:54.288216 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-993c4ae9-68c3-4445-95bc-84f6b3c60667 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:54.288648 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-993c4ae9-68c3-4445-95bc-84f6b3c60667 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:54.589788 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-993c4ae9-68c3-4445-95bc-84f6b3c60667 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc5a4676f6a416cbdc8c67ebd80cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e810a9bc3b44c4aa8ca2ddd0fa68f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:47:54.597779 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-993c4ae9-68c3-4445-95bc-84f6b3c60667 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] 10.222.0.13 "GET /compute/v2.1/servers/230c27ca-dfe2-4a74-aca7-106c1e5af8fc" status: 200 len: 1265 microversion: 2.1 time: 0.322894 Jun 23 11:47:54.598337 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 244/460] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:47:54 2022] GET /compute/v2.1/servers/230c27ca-dfe2-4a74-aca7-106c1e5af8fc => generated 1265 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:47:54.774109 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.virt.hardware [None req-fcf6c16b-2673-4f51-b6ed-8f5acaf99d9c tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Flavor limits 0:0:0 {{(pid=124669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 11:47:54.774561 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.virt.hardware [None req-fcf6c16b-2673-4f51-b6ed-8f5acaf99d9c tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Image limits 0:0:0 {{(pid=124669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 11:47:54.775027 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.virt.hardware [None req-fcf6c16b-2673-4f51-b6ed-8f5acaf99d9c tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Flavor pref 0:0:0 {{(pid=124669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 11:47:54.775434 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.virt.hardware [None req-fcf6c16b-2673-4f51-b6ed-8f5acaf99d9c tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Image pref 0:0:0 {{(pid=124669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 11:47:54.775857 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.virt.hardware [None req-fcf6c16b-2673-4f51-b6ed-8f5acaf99d9c tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 11:47:54.784603 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-fcf6c16b-2673-4f51-b6ed-8f5acaf99d9c tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:54.785047 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-fcf6c16b-2673-4f51-b6ed-8f5acaf99d9c tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:54.785835 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-fcf6c16b-2673-4f51-b6ed-8f5acaf99d9c tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:54.786268 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-fcf6c16b-2673-4f51-b6ed-8f5acaf99d9c tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:54.803299 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.quota [None req-fcf6c16b-2673-4f51-b6ed-8f5acaf99d9c tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Getting quotas for project ee135767dfc846469d64b658372994a8. Resources: {'cores', 'instances', 'ram'} {{(pid=124669) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:47:54.807221 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.quota [None req-fcf6c16b-2673-4f51-b6ed-8f5acaf99d9c tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Getting quotas for user b7fd8323d29d445f903e2103453e8ae6 and project ee135767dfc846469d64b658372994a8. Resources: {'cores', 'instances', 'ram'} {{(pid=124669) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:47:54.818645 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-fcf6c16b-2673-4f51-b6ed-8f5acaf99d9c tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Going to run 1 instances... {{(pid=124669) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 11:47:54.820863 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-fcf6c16b-2673-4f51-b6ed-8f5acaf99d9c tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 76c7fe26-3425-4f59-8a7e-4281b4b6ed3f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b19d6f23-214c-4432-bee6-455978023759',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124669) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 11:47:54.911736 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-fcf6c16b-2673-4f51-b6ed-8f5acaf99d9c tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.762018 Jun 23 11:47:54.912407 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 217/461] 10.222.0.13 () {60 vars in 1146 bytes} [Thu Jun 23 11:47:54 2022] POST /compute/v2.1/servers => generated 400 bytes in 763 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 11:47:54.923193 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-593427a9-21ea-49ba-b383-b5d910823974 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:47:54.923798 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-593427a9-21ea-49ba-b383-b5d910823974 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 76c7fe26-3425-4f59-8a7e-4281b4b6ed3f] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:47:54.978424 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-593427a9-21ea-49ba-b383-b5d910823974 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:47:54.986970 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-593427a9-21ea-49ba-b383-b5d910823974 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/76c7fe26-3425-4f59-8a7e-4281b4b6ed3f" status: 200 len: 1242 microversion: 2.1 time: 0.068284 Jun 23 11:47:54.987731 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 245/462] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:47:54 2022] GET /compute/v2.1/servers/76c7fe26-3425-4f59-8a7e-4281b4b6ed3f => generated 1242 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:47:55.614494 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-c49e0706-5386-4f7a-a4e3-6794e95f2d5b tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:47:55.615071 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-c49e0706-5386-4f7a-a4e3-6794e95f2d5b tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] [instance: 230c27ca-dfe2-4a74-aca7-106c1e5af8fc] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:47:55.621768 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c49e0706-5386-4f7a-a4e3-6794e95f2d5b tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:55.622216 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c49e0706-5386-4f7a-a4e3-6794e95f2d5b tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:55.623514 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c49e0706-5386-4f7a-a4e3-6794e95f2d5b tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:55.623940 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c49e0706-5386-4f7a-a4e3-6794e95f2d5b tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:55.753664 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-c49e0706-5386-4f7a-a4e3-6794e95f2d5b tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc5a4676f6a416cbdc8c67ebd80cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e810a9bc3b44c4aa8ca2ddd0fa68f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:47:55.761251 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-c49e0706-5386-4f7a-a4e3-6794e95f2d5b tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] 10.222.0.13 "GET /compute/v2.1/servers/230c27ca-dfe2-4a74-aca7-106c1e5af8fc" status: 200 len: 1265 microversion: 2.1 time: 0.150782 Jun 23 11:47:55.761819 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 218/463] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:47:55 2022] GET /compute/v2.1/servers/230c27ca-dfe2-4a74-aca7-106c1e5af8fc => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:47:56.004098 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-1bb45e89-ee5a-4a8f-bb2c-fe91b0eaf49a tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:47:56.004640 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-1bb45e89-ee5a-4a8f-bb2c-fe91b0eaf49a tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 76c7fe26-3425-4f59-8a7e-4281b4b6ed3f] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:47:56.010465 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1bb45e89-ee5a-4a8f-bb2c-fe91b0eaf49a tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:56.010938 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1bb45e89-ee5a-4a8f-bb2c-fe91b0eaf49a tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:56.011696 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1bb45e89-ee5a-4a8f-bb2c-fe91b0eaf49a tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:56.012123 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1bb45e89-ee5a-4a8f-bb2c-fe91b0eaf49a tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:56.076262 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-1bb45e89-ee5a-4a8f-bb2c-fe91b0eaf49a tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:47:56.084099 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-1bb45e89-ee5a-4a8f-bb2c-fe91b0eaf49a tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/76c7fe26-3425-4f59-8a7e-4281b4b6ed3f" status: 200 len: 1246 microversion: 2.1 time: 0.084484 Jun 23 11:47:56.084665 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 246/464] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:47:55 2022] GET /compute/v2.1/servers/76c7fe26-3425-4f59-8a7e-4281b4b6ed3f => generated 1246 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:47:56.778584 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-81467321-51f9-40b3-85a9-537747b05663 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:47:56.779146 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-81467321-51f9-40b3-85a9-537747b05663 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] [instance: 230c27ca-dfe2-4a74-aca7-106c1e5af8fc] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:47:56.786683 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-81467321-51f9-40b3-85a9-537747b05663 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:56.787158 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-81467321-51f9-40b3-85a9-537747b05663 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:56.787923 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-81467321-51f9-40b3-85a9-537747b05663 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:56.788365 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-81467321-51f9-40b3-85a9-537747b05663 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:56.921395 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-81467321-51f9-40b3-85a9-537747b05663 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc5a4676f6a416cbdc8c67ebd80cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e810a9bc3b44c4aa8ca2ddd0fa68f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:47:56.928837 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-81467321-51f9-40b3-85a9-537747b05663 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] 10.222.0.13 "GET /compute/v2.1/servers/230c27ca-dfe2-4a74-aca7-106c1e5af8fc" status: 200 len: 1452 microversion: 2.1 time: 0.154189 Jun 23 11:47:56.929468 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 219/465] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:47:56 2022] GET /compute/v2.1/servers/230c27ca-dfe2-4a74-aca7-106c1e5af8fc => generated 1452 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:47:56.945599 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-648b6a5c-17c3-41fc-ad13-fb52a61b7d1b tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:47:56.946211 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-648b6a5c-17c3-41fc-ad13-fb52a61b7d1b tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] [instance: 230c27ca-dfe2-4a74-aca7-106c1e5af8fc] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:47:56.952957 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-648b6a5c-17c3-41fc-ad13-fb52a61b7d1b tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:56.953405 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-648b6a5c-17c3-41fc-ad13-fb52a61b7d1b tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:56.954165 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-648b6a5c-17c3-41fc-ad13-fb52a61b7d1b tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:56.954628 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-648b6a5c-17c3-41fc-ad13-fb52a61b7d1b tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:57.083641 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-648b6a5c-17c3-41fc-ad13-fb52a61b7d1b tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc5a4676f6a416cbdc8c67ebd80cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e810a9bc3b44c4aa8ca2ddd0fa68f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:47:57.091423 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-648b6a5c-17c3-41fc-ad13-fb52a61b7d1b tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] 10.222.0.13 "GET /compute/v2.1/servers/230c27ca-dfe2-4a74-aca7-106c1e5af8fc" status: 200 len: 1452 microversion: 2.1 time: 0.149665 Jun 23 11:47:57.092024 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 247/466] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:47:56 2022] GET /compute/v2.1/servers/230c27ca-dfe2-4a74-aca7-106c1e5af8fc => generated 1452 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:47:57.101674 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-cc981513-7252-42db-b521-efc9da30640c tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:47:57.102322 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-cc981513-7252-42db-b521-efc9da30640c tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 76c7fe26-3425-4f59-8a7e-4281b4b6ed3f] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:47:57.108816 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-cc981513-7252-42db-b521-efc9da30640c tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:57.109293 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-cc981513-7252-42db-b521-efc9da30640c tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:57.110107 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-cc981513-7252-42db-b521-efc9da30640c tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:57.110792 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-cc981513-7252-42db-b521-efc9da30640c tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:57.176537 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-cc981513-7252-42db-b521-efc9da30640c tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:47:57.184013 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-cc981513-7252-42db-b521-efc9da30640c tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/76c7fe26-3425-4f59-8a7e-4281b4b6ed3f" status: 200 len: 1294 microversion: 2.1 time: 0.086819 Jun 23 11:47:57.184694 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 220/467] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:47:57 2022] GET /compute/v2.1/servers/76c7fe26-3425-4f59-8a7e-4281b4b6ed3f => generated 1294 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:47:58.202154 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-db494717-0e92-498f-b814-060c5338da2d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:47:58.203613 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-db494717-0e92-498f-b814-060c5338da2d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 76c7fe26-3425-4f59-8a7e-4281b4b6ed3f] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:47:58.209926 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-db494717-0e92-498f-b814-060c5338da2d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:58.210455 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-db494717-0e92-498f-b814-060c5338da2d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:58.211581 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-db494717-0e92-498f-b814-060c5338da2d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:58.212116 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-db494717-0e92-498f-b814-060c5338da2d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:58.290031 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-db494717-0e92-498f-b814-060c5338da2d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:47:58.298345 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-db494717-0e92-498f-b814-060c5338da2d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/76c7fe26-3425-4f59-8a7e-4281b4b6ed3f" status: 200 len: 1302 microversion: 2.1 time: 0.100975 Jun 23 11:47:58.299258 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 248/468] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:47:58 2022] GET /compute/v2.1/servers/76c7fe26-3425-4f59-8a7e-4281b4b6ed3f => generated 1302 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:47:59.124731 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [req-ae81cd30-a985-454a-a6df-dbe2e84bb9fd req-41905b5e-7a7b-4d23-935b-4a9d1f3e265e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "230c27ca-dfe2-4a74-aca7-106c1e5af8fc", "tag": "22ef1251-f87b-4a4f-9c86-55c2036a4cdc"}]} {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:47:59.133155 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [req-ae81cd30-a985-454a-a6df-dbe2e84bb9fd req-41905b5e-7a7b-4d23-935b-4a9d1f3e265e service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:59.133592 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [req-ae81cd30-a985-454a-a6df-dbe2e84bb9fd req-41905b5e-7a7b-4d23-935b-4a9d1f3e265e service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:59.146847 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.compute.server_external_events [req-ae81cd30-a985-454a-a6df-dbe2e84bb9fd req-41905b5e-7a7b-4d23-935b-4a9d1f3e265e service nova] Creating event network-changed:22ef1251-f87b-4a4f-9c86-55c2036a4cdc for instance 230c27ca-dfe2-4a74-aca7-106c1e5af8fc on hv-cinder-82099 Jun 23 11:47:59.152533 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [req-ae81cd30-a985-454a-a6df-dbe2e84bb9fd req-41905b5e-7a7b-4d23-935b-4a9d1f3e265e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032968 Jun 23 11:47:59.156699 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 221/469] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:47:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:47:59.318698 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-0e1a486e-03c1-4d38-a034-94f66aacdc25 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:47:59.322308 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-0e1a486e-03c1-4d38-a034-94f66aacdc25 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 76c7fe26-3425-4f59-8a7e-4281b4b6ed3f] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:47:59.333681 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-0e1a486e-03c1-4d38-a034-94f66aacdc25 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:59.334681 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-0e1a486e-03c1-4d38-a034-94f66aacdc25 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:59.336601 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-0e1a486e-03c1-4d38-a034-94f66aacdc25 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:59.337275 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-0e1a486e-03c1-4d38-a034-94f66aacdc25 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:59.556814 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-0e1a486e-03c1-4d38-a034-94f66aacdc25 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:47:59.565535 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-0e1a486e-03c1-4d38-a034-94f66aacdc25 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/76c7fe26-3425-4f59-8a7e-4281b4b6ed3f" status: 200 len: 1366 microversion: 2.1 time: 0.252988 Jun 23 11:47:59.566476 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 249/470] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:47:59 2022] GET /compute/v2.1/servers/76c7fe26-3425-4f59-8a7e-4281b4b6ed3f => generated 1366 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:47:59.642305 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-8d353f7e-b9d7-4d53-ba9a-179c4fdbaff0 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:47:59.644551 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-8d353f7e-b9d7-4d53-ba9a-179c4fdbaff0 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:47:59.653179 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-8d353f7e-b9d7-4d53-ba9a-179c4fdbaff0 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:59.653632 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-8d353f7e-b9d7-4d53-ba9a-179c4fdbaff0 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:59.658158 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-8d353f7e-b9d7-4d53-ba9a-179c4fdbaff0 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:47:59.658682 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-8d353f7e-b9d7-4d53-ba9a-179c4fdbaff0 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:47:59.693121 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-8d353f7e-b9d7-4d53-ba9a-179c4fdbaff0 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200/ips" status: 200 len: 147 microversion: 2.1 time: 0.055825 Jun 23 11:47:59.694581 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 222/471] 10.222.0.13 () {58 vars in 1247 bytes} [Thu Jun 23 11:47:59 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200/ips => generated 147 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:48:00.103129 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [req-1df0ee31-7e8c-4255-8371-52af6a956d2b req-f6795344-26b3-4de0-b6cd-2471ddccbe5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76c7fe26-3425-4f59-8a7e-4281b4b6ed3f", "tag": "6c53408c-0865-4915-8148-5fd2f10f06a9"}]} {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:48:00.111916 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-1df0ee31-7e8c-4255-8371-52af6a956d2b req-f6795344-26b3-4de0-b6cd-2471ddccbe5a service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:00.112610 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-1df0ee31-7e8c-4255-8371-52af6a956d2b req-f6795344-26b3-4de0-b6cd-2471ddccbe5a service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:00.133442 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.compute.server_external_events [req-1df0ee31-7e8c-4255-8371-52af6a956d2b req-f6795344-26b3-4de0-b6cd-2471ddccbe5a service nova] Creating event network-changed:6c53408c-0865-4915-8148-5fd2f10f06a9 for instance 76c7fe26-3425-4f59-8a7e-4281b4b6ed3f on hv-cinder-82099 Jun 23 11:48:00.139561 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [req-1df0ee31-7e8c-4255-8371-52af6a956d2b req-f6795344-26b3-4de0-b6cd-2471ddccbe5a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040771 Jun 23 11:48:00.140165 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 250/472] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:48:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:48:00.585224 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-d450d922-4430-45b0-afa6-4ca02667c625 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:48:00.585831 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-d450d922-4430-45b0-afa6-4ca02667c625 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 76c7fe26-3425-4f59-8a7e-4281b4b6ed3f] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:48:00.593192 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-d450d922-4430-45b0-afa6-4ca02667c625 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:00.593649 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-d450d922-4430-45b0-afa6-4ca02667c625 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:00.594407 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-d450d922-4430-45b0-afa6-4ca02667c625 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:00.594861 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-d450d922-4430-45b0-afa6-4ca02667c625 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:00.615224 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:48:00.809213 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-d450d922-4430-45b0-afa6-4ca02667c625 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:48:00.817185 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-d450d922-4430-45b0-afa6-4ca02667c625 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/76c7fe26-3425-4f59-8a7e-4281b4b6ed3f" status: 200 len: 1366 microversion: 2.1 time: 0.235798 Jun 23 11:48:00.817824 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 223/473] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:48:00 2022] GET /compute/v2.1/servers/76c7fe26-3425-4f59-8a7e-4281b4b6ed3f => generated 1366 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:48:01.835095 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-7506efd6-105d-475b-9124-c46dd591ff40 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:48:01.835788 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-7506efd6-105d-475b-9124-c46dd591ff40 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 76c7fe26-3425-4f59-8a7e-4281b4b6ed3f] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:48:01.842914 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-7506efd6-105d-475b-9124-c46dd591ff40 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:01.843353 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-7506efd6-105d-475b-9124-c46dd591ff40 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:01.844103 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-7506efd6-105d-475b-9124-c46dd591ff40 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:01.844531 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-7506efd6-105d-475b-9124-c46dd591ff40 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:02.205162 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-7506efd6-105d-475b-9124-c46dd591ff40 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:48:02.212655 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-7506efd6-105d-475b-9124-c46dd591ff40 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/76c7fe26-3425-4f59-8a7e-4281b4b6ed3f" status: 200 len: 1366 microversion: 2.1 time: 0.381753 Jun 23 11:48:02.213229 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 251/474] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:48:01 2022] GET /compute/v2.1/servers/76c7fe26-3425-4f59-8a7e-4281b4b6ed3f => generated 1366 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:48:03.229920 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-f73874b1-4eba-4628-aefd-61b630ed458b tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:48:03.230588 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-f73874b1-4eba-4628-aefd-61b630ed458b tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 76c7fe26-3425-4f59-8a7e-4281b4b6ed3f] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:48:03.238125 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-f73874b1-4eba-4628-aefd-61b630ed458b tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:03.238609 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-f73874b1-4eba-4628-aefd-61b630ed458b tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:03.239361 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-f73874b1-4eba-4628-aefd-61b630ed458b tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:03.239797 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-f73874b1-4eba-4628-aefd-61b630ed458b tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:03.364720 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-f73874b1-4eba-4628-aefd-61b630ed458b tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:48:03.372107 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-f73874b1-4eba-4628-aefd-61b630ed458b tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/76c7fe26-3425-4f59-8a7e-4281b4b6ed3f" status: 200 len: 1366 microversion: 2.1 time: 0.146410 Jun 23 11:48:03.372615 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 224/475] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:48:03 2022] GET /compute/v2.1/servers/76c7fe26-3425-4f59-8a7e-4281b4b6ed3f => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:48:04.388965 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-413cae87-ce17-4526-85cb-4cd8ebb8d99b tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:48:04.390330 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-413cae87-ce17-4526-85cb-4cd8ebb8d99b tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 76c7fe26-3425-4f59-8a7e-4281b4b6ed3f] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:48:04.396779 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-413cae87-ce17-4526-85cb-4cd8ebb8d99b tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:04.397220 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-413cae87-ce17-4526-85cb-4cd8ebb8d99b tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:04.397966 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-413cae87-ce17-4526-85cb-4cd8ebb8d99b tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:04.398394 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-413cae87-ce17-4526-85cb-4cd8ebb8d99b tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:04.529972 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-413cae87-ce17-4526-85cb-4cd8ebb8d99b tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:48:04.537609 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-413cae87-ce17-4526-85cb-4cd8ebb8d99b tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/76c7fe26-3425-4f59-8a7e-4281b4b6ed3f" status: 200 len: 1366 microversion: 2.1 time: 0.152427 Jun 23 11:48:04.538146 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 252/476] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:48:04 2022] GET /compute/v2.1/servers/76c7fe26-3425-4f59-8a7e-4281b4b6ed3f => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:48:05.555078 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-c9a970b8-8566-4296-90db-a0522ec29a3d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:48:05.558788 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-c9a970b8-8566-4296-90db-a0522ec29a3d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 76c7fe26-3425-4f59-8a7e-4281b4b6ed3f] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:48:05.558788 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_cell0:SELECT=2 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:48:05.558788 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_cell0:SELECT=10 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:48:05.559332 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=7 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:48:05.565156 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c9a970b8-8566-4296-90db-a0522ec29a3d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:05.568934 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c9a970b8-8566-4296-90db-a0522ec29a3d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:05.568934 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c9a970b8-8566-4296-90db-a0522ec29a3d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:05.568934 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c9a970b8-8566-4296-90db-a0522ec29a3d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:05.695619 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-c9a970b8-8566-4296-90db-a0522ec29a3d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:48:05.703307 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-c9a970b8-8566-4296-90db-a0522ec29a3d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/76c7fe26-3425-4f59-8a7e-4281b4b6ed3f" status: 200 len: 1366 microversion: 2.1 time: 0.152029 Jun 23 11:48:05.703892 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 225/477] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:48:05 2022] GET /compute/v2.1/servers/76c7fe26-3425-4f59-8a7e-4281b4b6ed3f => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:48:06.720839 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-6cc5e815-6c3f-40ec-afc7-5137fd27d767 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:48:06.721367 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-6cc5e815-6c3f-40ec-afc7-5137fd27d767 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 76c7fe26-3425-4f59-8a7e-4281b4b6ed3f] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:48:06.723626 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_cell0:SELECT=2 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:48:06.728359 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-6cc5e815-6c3f-40ec-afc7-5137fd27d767 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:06.728800 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-6cc5e815-6c3f-40ec-afc7-5137fd27d767 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:06.729542 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-6cc5e815-6c3f-40ec-afc7-5137fd27d767 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:06.729970 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-6cc5e815-6c3f-40ec-afc7-5137fd27d767 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:06.748671 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_cell1:SELECT=100 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:48:06.862628 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-6cc5e815-6c3f-40ec-afc7-5137fd27d767 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:48:06.870017 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-6cc5e815-6c3f-40ec-afc7-5137fd27d767 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/76c7fe26-3425-4f59-8a7e-4281b4b6ed3f" status: 200 len: 1366 microversion: 2.1 time: 0.153887 Jun 23 11:48:06.870596 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 253/478] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:48:06 2022] GET /compute/v2.1/servers/76c7fe26-3425-4f59-8a7e-4281b4b6ed3f => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:48:07.546734 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-8369cd5c-2793-4bd5-af47-144cfbf6d209 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f0c792e1-91a2-45a7-83a6-dceabd9d79e0"}} {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:48:07.547843 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-8369cd5c-2793-4bd5-af47-144cfbf6d209 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:48:07.554120 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-8369cd5c-2793-4bd5-af47-144cfbf6d209 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:07.554583 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-8369cd5c-2793-4bd5-af47-144cfbf6d209 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:07.555363 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-8369cd5c-2793-4bd5-af47-144cfbf6d209 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:07.555793 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-8369cd5c-2793-4bd5-af47-144cfbf6d209 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:07.887461 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-f289eb9f-4570-4355-a33b-9c8f8da9c3f0 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:48:07.888068 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-f289eb9f-4570-4355-a33b-9c8f8da9c3f0 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 76c7fe26-3425-4f59-8a7e-4281b4b6ed3f] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:48:07.889901 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_api:SELECT=47 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:48:07.894617 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-f289eb9f-4570-4355-a33b-9c8f8da9c3f0 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:07.899386 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-f289eb9f-4570-4355-a33b-9c8f8da9c3f0 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:07.899386 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-f289eb9f-4570-4355-a33b-9c8f8da9c3f0 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:07.899386 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-f289eb9f-4570-4355-a33b-9c8f8da9c3f0 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:08.025647 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-f289eb9f-4570-4355-a33b-9c8f8da9c3f0 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:48:08.034118 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-f289eb9f-4570-4355-a33b-9c8f8da9c3f0 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/76c7fe26-3425-4f59-8a7e-4281b4b6ed3f" status: 200 len: 1366 microversion: 2.1 time: 0.150357 Jun 23 11:48:08.034638 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 254/479] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:48:07 2022] GET /compute/v2.1/servers/76c7fe26-3425-4f59-8a7e-4281b4b6ed3f => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:48:09.052191 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-3f528a2d-d612-42aa-bc6a-5fd6329860f4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:48:09.052800 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-3f528a2d-d612-42aa-bc6a-5fd6329860f4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 76c7fe26-3425-4f59-8a7e-4281b4b6ed3f] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:48:09.059007 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-3f528a2d-d612-42aa-bc6a-5fd6329860f4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:09.059451 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-3f528a2d-d612-42aa-bc6a-5fd6329860f4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:09.060198 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-3f528a2d-d612-42aa-bc6a-5fd6329860f4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:09.060622 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-3f528a2d-d612-42aa-bc6a-5fd6329860f4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:09.194262 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-3f528a2d-d612-42aa-bc6a-5fd6329860f4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:48:09.202224 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-3f528a2d-d612-42aa-bc6a-5fd6329860f4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/76c7fe26-3425-4f59-8a7e-4281b4b6ed3f" status: 200 len: 1366 microversion: 2.1 time: 0.153255 Jun 23 11:48:09.203125 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 255/480] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:48:09 2022] GET /compute/v2.1/servers/76c7fe26-3425-4f59-8a7e-4281b4b6ed3f => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:48:10.219942 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-2a7f5f54-fa50-48c5-99e6-6de192d2c301 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:48:10.220576 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-2a7f5f54-fa50-48c5-99e6-6de192d2c301 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 76c7fe26-3425-4f59-8a7e-4281b4b6ed3f] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:48:10.226643 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-2a7f5f54-fa50-48c5-99e6-6de192d2c301 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:10.227102 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-2a7f5f54-fa50-48c5-99e6-6de192d2c301 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:10.227856 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-2a7f5f54-fa50-48c5-99e6-6de192d2c301 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:10.228286 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-2a7f5f54-fa50-48c5-99e6-6de192d2c301 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:10.353248 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-2a7f5f54-fa50-48c5-99e6-6de192d2c301 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:48:10.360752 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-2a7f5f54-fa50-48c5-99e6-6de192d2c301 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/76c7fe26-3425-4f59-8a7e-4281b4b6ed3f" status: 200 len: 1366 microversion: 2.1 time: 0.145353 Jun 23 11:48:10.363119 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 256/481] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:48:10 2022] GET /compute/v2.1/servers/76c7fe26-3425-4f59-8a7e-4281b4b6ed3f => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:48:11.377640 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-edbd77da-55a6-43f3-a3ec-f8f5500991e9 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:48:11.378232 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-edbd77da-55a6-43f3-a3ec-f8f5500991e9 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 76c7fe26-3425-4f59-8a7e-4281b4b6ed3f] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:48:11.384221 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-edbd77da-55a6-43f3-a3ec-f8f5500991e9 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:11.384664 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-edbd77da-55a6-43f3-a3ec-f8f5500991e9 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:11.385409 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-edbd77da-55a6-43f3-a3ec-f8f5500991e9 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:11.385838 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-edbd77da-55a6-43f3-a3ec-f8f5500991e9 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:11.514929 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-edbd77da-55a6-43f3-a3ec-f8f5500991e9 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:48:11.523016 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-edbd77da-55a6-43f3-a3ec-f8f5500991e9 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/76c7fe26-3425-4f59-8a7e-4281b4b6ed3f" status: 200 len: 1366 microversion: 2.1 time: 0.149765 Jun 23 11:48:11.523573 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 257/482] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:48:11 2022] GET /compute/v2.1/servers/76c7fe26-3425-4f59-8a7e-4281b4b6ed3f => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:48:12.539629 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-e344d5fd-d309-4413-83e9-b3581ff77423 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:48:12.540242 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-e344d5fd-d309-4413-83e9-b3581ff77423 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 76c7fe26-3425-4f59-8a7e-4281b4b6ed3f] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:48:12.546255 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-e344d5fd-d309-4413-83e9-b3581ff77423 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:12.546734 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-e344d5fd-d309-4413-83e9-b3581ff77423 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:12.548020 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-e344d5fd-d309-4413-83e9-b3581ff77423 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:12.548451 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-e344d5fd-d309-4413-83e9-b3581ff77423 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:12.677027 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-e344d5fd-d309-4413-83e9-b3581ff77423 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:48:12.684315 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-e344d5fd-d309-4413-83e9-b3581ff77423 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/76c7fe26-3425-4f59-8a7e-4281b4b6ed3f" status: 200 len: 1366 microversion: 2.1 time: 0.148431 Jun 23 11:48:12.684902 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 258/483] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:48:12 2022] GET /compute/v2.1/servers/76c7fe26-3425-4f59-8a7e-4281b4b6ed3f => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:48:13.701788 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-32598897-6e1a-4ff9-802a-cd4b9879cdb6 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:48:13.702414 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-32598897-6e1a-4ff9-802a-cd4b9879cdb6 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 76c7fe26-3425-4f59-8a7e-4281b4b6ed3f] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:48:13.708320 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-32598897-6e1a-4ff9-802a-cd4b9879cdb6 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:13.708765 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-32598897-6e1a-4ff9-802a-cd4b9879cdb6 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:13.709529 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-32598897-6e1a-4ff9-802a-cd4b9879cdb6 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:13.709964 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-32598897-6e1a-4ff9-802a-cd4b9879cdb6 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:13.842336 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-32598897-6e1a-4ff9-802a-cd4b9879cdb6 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:48:13.851189 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-32598897-6e1a-4ff9-802a-cd4b9879cdb6 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/76c7fe26-3425-4f59-8a7e-4281b4b6ed3f" status: 200 len: 1366 microversion: 2.1 time: 0.153112 Jun 23 11:48:13.851766 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 259/484] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:48:13 2022] GET /compute/v2.1/servers/76c7fe26-3425-4f59-8a7e-4281b4b6ed3f => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:48:14.371048 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-8369cd5c-2793-4bd5-af47-144cfbf6d209 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "POST /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 6.829072 Jun 23 11:48:14.371669 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 226/485] 10.222.0.13 () {60 vars in 1322 bytes} [Thu Jun 23 11:48:07 2022] POST /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200/os-volume_attachments => generated 194 bytes in 6830 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:48:14.868892 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-8709d0a1-46eb-4100-88fe-6e01c853a8a7 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:48:14.869504 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-8709d0a1-46eb-4100-88fe-6e01c853a8a7 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 76c7fe26-3425-4f59-8a7e-4281b4b6ed3f] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:48:14.875655 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-8709d0a1-46eb-4100-88fe-6e01c853a8a7 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:14.876105 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-8709d0a1-46eb-4100-88fe-6e01c853a8a7 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:14.877460 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-8709d0a1-46eb-4100-88fe-6e01c853a8a7 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:14.877891 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-8709d0a1-46eb-4100-88fe-6e01c853a8a7 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:15.002991 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-8709d0a1-46eb-4100-88fe-6e01c853a8a7 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:48:15.010737 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-8709d0a1-46eb-4100-88fe-6e01c853a8a7 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/76c7fe26-3425-4f59-8a7e-4281b4b6ed3f" status: 200 len: 1366 microversion: 2.1 time: 0.145698 Jun 23 11:48:15.011299 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 260/486] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:48:14 2022] GET /compute/v2.1/servers/76c7fe26-3425-4f59-8a7e-4281b4b6ed3f => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:48:16.028867 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-a85aee0a-6609-4d57-b532-17321ce77f44 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:48:16.029472 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-a85aee0a-6609-4d57-b532-17321ce77f44 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 76c7fe26-3425-4f59-8a7e-4281b4b6ed3f] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:48:16.036060 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-a85aee0a-6609-4d57-b532-17321ce77f44 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:16.036505 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-a85aee0a-6609-4d57-b532-17321ce77f44 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:16.037256 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-a85aee0a-6609-4d57-b532-17321ce77f44 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:16.037685 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-a85aee0a-6609-4d57-b532-17321ce77f44 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:16.171328 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-a85aee0a-6609-4d57-b532-17321ce77f44 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:48:16.179461 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-a85aee0a-6609-4d57-b532-17321ce77f44 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/76c7fe26-3425-4f59-8a7e-4281b4b6ed3f" status: 200 len: 1366 microversion: 2.1 time: 0.155381 Jun 23 11:48:16.180015 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 227/487] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:48:16 2022] GET /compute/v2.1/servers/76c7fe26-3425-4f59-8a7e-4281b4b6ed3f => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:48:17.196054 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-32f6e9c6-db25-43fe-abbb-91ed7b4afded tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:48:17.196659 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-32f6e9c6-db25-43fe-abbb-91ed7b4afded tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 76c7fe26-3425-4f59-8a7e-4281b4b6ed3f] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:48:17.202778 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-32f6e9c6-db25-43fe-abbb-91ed7b4afded tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:17.203225 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-32f6e9c6-db25-43fe-abbb-91ed7b4afded tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:17.203970 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-32f6e9c6-db25-43fe-abbb-91ed7b4afded tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:17.204920 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-32f6e9c6-db25-43fe-abbb-91ed7b4afded tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:17.332583 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-32f6e9c6-db25-43fe-abbb-91ed7b4afded tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:48:17.340167 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-32f6e9c6-db25-43fe-abbb-91ed7b4afded tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/76c7fe26-3425-4f59-8a7e-4281b4b6ed3f" status: 200 len: 1366 microversion: 2.1 time: 0.147958 Jun 23 11:48:17.340737 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 261/488] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:48:17 2022] GET /compute/v2.1/servers/76c7fe26-3425-4f59-8a7e-4281b4b6ed3f => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:48:18.356946 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-83892176-b761-4a92-a8f0-cdddb2daebf4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:48:18.357471 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-83892176-b761-4a92-a8f0-cdddb2daebf4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 76c7fe26-3425-4f59-8a7e-4281b4b6ed3f] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:48:18.364540 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-83892176-b761-4a92-a8f0-cdddb2daebf4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:18.365010 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-83892176-b761-4a92-a8f0-cdddb2daebf4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:18.365845 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-83892176-b761-4a92-a8f0-cdddb2daebf4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:18.366284 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-83892176-b761-4a92-a8f0-cdddb2daebf4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:18.494221 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-83892176-b761-4a92-a8f0-cdddb2daebf4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:48:18.501650 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-83892176-b761-4a92-a8f0-cdddb2daebf4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/76c7fe26-3425-4f59-8a7e-4281b4b6ed3f" status: 200 len: 1366 microversion: 2.1 time: 0.148636 Jun 23 11:48:18.502206 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 228/489] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:48:18 2022] GET /compute/v2.1/servers/76c7fe26-3425-4f59-8a7e-4281b4b6ed3f => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:48:19.518453 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-4c62e5e3-adb2-40a6-9ea1-56b0f13ce5c4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:48:19.519133 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-4c62e5e3-adb2-40a6-9ea1-56b0f13ce5c4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 76c7fe26-3425-4f59-8a7e-4281b4b6ed3f] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:48:19.525929 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-4c62e5e3-adb2-40a6-9ea1-56b0f13ce5c4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:19.526375 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-4c62e5e3-adb2-40a6-9ea1-56b0f13ce5c4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:19.527164 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-4c62e5e3-adb2-40a6-9ea1-56b0f13ce5c4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:19.527597 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-4c62e5e3-adb2-40a6-9ea1-56b0f13ce5c4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:19.659348 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-4c62e5e3-adb2-40a6-9ea1-56b0f13ce5c4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:48:19.667612 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-4c62e5e3-adb2-40a6-9ea1-56b0f13ce5c4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/76c7fe26-3425-4f59-8a7e-4281b4b6ed3f" status: 200 len: 1366 microversion: 2.1 time: 0.153060 Jun 23 11:48:19.668391 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 262/490] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:48:19 2022] GET /compute/v2.1/servers/76c7fe26-3425-4f59-8a7e-4281b4b6ed3f => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:48:20.685070 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-192b28d9-a64a-4f55-89c9-c8489e1a8fee tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:48:20.685671 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-192b28d9-a64a-4f55-89c9-c8489e1a8fee tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 76c7fe26-3425-4f59-8a7e-4281b4b6ed3f] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:48:20.692126 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-192b28d9-a64a-4f55-89c9-c8489e1a8fee tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:20.693250 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-192b28d9-a64a-4f55-89c9-c8489e1a8fee tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:20.694007 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-192b28d9-a64a-4f55-89c9-c8489e1a8fee tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:20.694436 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-192b28d9-a64a-4f55-89c9-c8489e1a8fee tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:20.829249 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-192b28d9-a64a-4f55-89c9-c8489e1a8fee tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:48:20.836853 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-192b28d9-a64a-4f55-89c9-c8489e1a8fee tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/76c7fe26-3425-4f59-8a7e-4281b4b6ed3f" status: 200 len: 1366 microversion: 2.1 time: 0.155597 Jun 23 11:48:20.837688 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 229/491] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:48:20 2022] GET /compute/v2.1/servers/76c7fe26-3425-4f59-8a7e-4281b4b6ed3f => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:48:20.881739 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [req-775eef4d-68e4-44e9-bf40-32f9b451f020 req-eff227c2-0f31-4c2d-9846-81f1653a58c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76c7fe26-3425-4f59-8a7e-4281b4b6ed3f", "name": "network-vif-plugged", "status": "completed", "tag": "6c53408c-0865-4915-8148-5fd2f10f06a9"}]} {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:48:20.890376 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-775eef4d-68e4-44e9-bf40-32f9b451f020 req-eff227c2-0f31-4c2d-9846-81f1653a58c2 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:20.890658 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-775eef4d-68e4-44e9-bf40-32f9b451f020 req-eff227c2-0f31-4c2d-9846-81f1653a58c2 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:20.902010 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.compute.server_external_events [req-775eef4d-68e4-44e9-bf40-32f9b451f020 req-eff227c2-0f31-4c2d-9846-81f1653a58c2 service nova] Creating event network-vif-plugged:6c53408c-0865-4915-8148-5fd2f10f06a9 for instance 76c7fe26-3425-4f59-8a7e-4281b4b6ed3f on hv-cinder-82099 Jun 23 11:48:20.911060 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [req-775eef4d-68e4-44e9-bf40-32f9b451f020 req-eff227c2-0f31-4c2d-9846-81f1653a58c2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032192 Jun 23 11:48:20.911060 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 263/492] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:48:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:48:21.853537 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-fcededd2-9466-421f-9119-4b32a3eab67b tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:48:21.854277 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-fcededd2-9466-421f-9119-4b32a3eab67b tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 76c7fe26-3425-4f59-8a7e-4281b4b6ed3f] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:48:21.860771 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-fcededd2-9466-421f-9119-4b32a3eab67b tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:21.861216 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-fcededd2-9466-421f-9119-4b32a3eab67b tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:21.862000 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-fcededd2-9466-421f-9119-4b32a3eab67b tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:21.862430 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-fcededd2-9466-421f-9119-4b32a3eab67b tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:21.991665 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-fcededd2-9466-421f-9119-4b32a3eab67b tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:48:21.999033 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-fcededd2-9466-421f-9119-4b32a3eab67b tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/76c7fe26-3425-4f59-8a7e-4281b4b6ed3f" status: 200 len: 1366 microversion: 2.1 time: 0.149238 Jun 23 11:48:21.999594 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 230/493] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:48:21 2022] GET /compute/v2.1/servers/76c7fe26-3425-4f59-8a7e-4281b4b6ed3f => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:48:23.016621 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-5ea42869-b9ea-4e29-95c0-035debe82293 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:48:23.017313 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-5ea42869-b9ea-4e29-95c0-035debe82293 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 76c7fe26-3425-4f59-8a7e-4281b4b6ed3f] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:48:23.024318 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-5ea42869-b9ea-4e29-95c0-035debe82293 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:23.024768 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-5ea42869-b9ea-4e29-95c0-035debe82293 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:23.025530 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-5ea42869-b9ea-4e29-95c0-035debe82293 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:23.025961 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-5ea42869-b9ea-4e29-95c0-035debe82293 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:23.154807 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-5ea42869-b9ea-4e29-95c0-035debe82293 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:48:23.162273 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-5ea42869-b9ea-4e29-95c0-035debe82293 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/76c7fe26-3425-4f59-8a7e-4281b4b6ed3f" status: 200 len: 1366 microversion: 2.1 time: 0.149904 Jun 23 11:48:23.162896 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 264/494] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:48:23 2022] GET /compute/v2.1/servers/76c7fe26-3425-4f59-8a7e-4281b4b6ed3f => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:48:23.261535 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-35ad89f7-cc78-4a62-a4ef-30d56001a701 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:48:23.262014 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-35ad89f7-cc78-4a62-a4ef-30d56001a701 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] [instance: a17006fa-d781-4551-a96c-1ca769325ae6] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:48:23.268414 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-35ad89f7-cc78-4a62-a4ef-30d56001a701 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:23.268865 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-35ad89f7-cc78-4a62-a4ef-30d56001a701 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:23.269622 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-35ad89f7-cc78-4a62-a4ef-30d56001a701 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:23.270060 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-35ad89f7-cc78-4a62-a4ef-30d56001a701 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:23.394380 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.objects.instance [None req-35ad89f7-cc78-4a62-a4ef-30d56001a701 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lazy-loading 'services' on Instance uuid a17006fa-d781-4551-a96c-1ca769325ae6 {{(pid=124669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:48:23.640761 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-35ad89f7-cc78-4a62-a4ef-30d56001a701 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a17006fa-d781-4551-a96c-1ca769325ae6/os-volume_attachments/07cde5ac-aa14-43b0-98dc-74febcdeecd6" status: 202 len: 0 microversion: 2.1 time: 0.382858 Jun 23 11:48:23.641312 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 231/495] 10.222.0.13 () {58 vars in 1415 bytes} [Thu Jun 23 11:48:23 2022] DELETE /compute/v2.1/servers/a17006fa-d781-4551-a96c-1ca769325ae6/os-volume_attachments/07cde5ac-aa14-43b0-98dc-74febcdeecd6 => generated 0 bytes in 384 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 11:48:24.179549 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-805bf22a-8f1d-4344-ba1e-464edebc7984 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:48:24.180083 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-805bf22a-8f1d-4344-ba1e-464edebc7984 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 76c7fe26-3425-4f59-8a7e-4281b4b6ed3f] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:48:24.186059 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-805bf22a-8f1d-4344-ba1e-464edebc7984 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:24.186505 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-805bf22a-8f1d-4344-ba1e-464edebc7984 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:24.187294 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-805bf22a-8f1d-4344-ba1e-464edebc7984 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:24.187727 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-805bf22a-8f1d-4344-ba1e-464edebc7984 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:24.316891 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-805bf22a-8f1d-4344-ba1e-464edebc7984 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:48:24.324861 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-805bf22a-8f1d-4344-ba1e-464edebc7984 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/76c7fe26-3425-4f59-8a7e-4281b4b6ed3f" status: 200 len: 1366 microversion: 2.1 time: 0.149428 Jun 23 11:48:24.325424 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 265/496] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:48:24 2022] GET /compute/v2.1/servers/76c7fe26-3425-4f59-8a7e-4281b4b6ed3f => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:48:25.343363 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-36b94c4e-4edb-4625-9bf6-8891d1229385 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:48:25.344053 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-36b94c4e-4edb-4625-9bf6-8891d1229385 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 76c7fe26-3425-4f59-8a7e-4281b4b6ed3f] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:48:25.351336 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-36b94c4e-4edb-4625-9bf6-8891d1229385 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:25.351778 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-36b94c4e-4edb-4625-9bf6-8891d1229385 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:25.352530 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-36b94c4e-4edb-4625-9bf6-8891d1229385 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:25.352957 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-36b94c4e-4edb-4625-9bf6-8891d1229385 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:25.479331 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-36b94c4e-4edb-4625-9bf6-8891d1229385 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:48:25.486776 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-36b94c4e-4edb-4625-9bf6-8891d1229385 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/76c7fe26-3425-4f59-8a7e-4281b4b6ed3f" status: 200 len: 1366 microversion: 2.1 time: 0.147947 Jun 23 11:48:25.487333 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 232/497] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:48:25 2022] GET /compute/v2.1/servers/76c7fe26-3425-4f59-8a7e-4281b4b6ed3f => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:48:26.505096 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-5ca98dad-71c1-4bbe-bd13-4b6a543dc1f4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:48:26.505705 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-5ca98dad-71c1-4bbe-bd13-4b6a543dc1f4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 76c7fe26-3425-4f59-8a7e-4281b4b6ed3f] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:48:26.513963 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-5ca98dad-71c1-4bbe-bd13-4b6a543dc1f4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:26.514684 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-5ca98dad-71c1-4bbe-bd13-4b6a543dc1f4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:26.515456 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-5ca98dad-71c1-4bbe-bd13-4b6a543dc1f4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:26.515887 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-5ca98dad-71c1-4bbe-bd13-4b6a543dc1f4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:26.646291 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-5ca98dad-71c1-4bbe-bd13-4b6a543dc1f4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:48:26.653693 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-5ca98dad-71c1-4bbe-bd13-4b6a543dc1f4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/76c7fe26-3425-4f59-8a7e-4281b4b6ed3f" status: 200 len: 1366 microversion: 2.1 time: 0.154252 Jun 23 11:48:26.654244 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 266/498] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:48:26 2022] GET /compute/v2.1/servers/76c7fe26-3425-4f59-8a7e-4281b4b6ed3f => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:48:27.669912 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-672d68ac-52d0-49a1-99d2-8808844e95dd tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:48:27.670599 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-672d68ac-52d0-49a1-99d2-8808844e95dd tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 76c7fe26-3425-4f59-8a7e-4281b4b6ed3f] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:48:27.677243 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-672d68ac-52d0-49a1-99d2-8808844e95dd tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:27.677690 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-672d68ac-52d0-49a1-99d2-8808844e95dd tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:27.678480 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-672d68ac-52d0-49a1-99d2-8808844e95dd tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:27.679584 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-672d68ac-52d0-49a1-99d2-8808844e95dd tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:27.813224 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-672d68ac-52d0-49a1-99d2-8808844e95dd tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:48:27.821872 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-672d68ac-52d0-49a1-99d2-8808844e95dd tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/76c7fe26-3425-4f59-8a7e-4281b4b6ed3f" status: 200 len: 1556 microversion: 2.1 time: 0.155830 Jun 23 11:48:27.822442 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 233/499] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:48:27 2022] GET /compute/v2.1/servers/76c7fe26-3425-4f59-8a7e-4281b4b6ed3f => generated 1556 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:48:27.841566 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-ea33de09-de29-4150-a514-2dcd19a3b979 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:48:27.842142 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-ea33de09-de29-4150-a514-2dcd19a3b979 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 76c7fe26-3425-4f59-8a7e-4281b4b6ed3f] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:48:27.849353 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-ea33de09-de29-4150-a514-2dcd19a3b979 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:27.850053 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-ea33de09-de29-4150-a514-2dcd19a3b979 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:27.851077 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-ea33de09-de29-4150-a514-2dcd19a3b979 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:27.851586 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-ea33de09-de29-4150-a514-2dcd19a3b979 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:27.931846 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-ea33de09-de29-4150-a514-2dcd19a3b979 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/76c7fe26-3425-4f59-8a7e-4281b4b6ed3f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095640 Jun 23 11:48:27.932466 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 267/500] 10.222.0.13 () {58 vars in 1274 bytes} [Thu Jun 23 11:48:27 2022] GET /compute/v2.1/servers/76c7fe26-3425-4f59-8a7e-4281b4b6ed3f/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:48:28.194078 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-1d49faf2-39d3-4d7e-8f0f-e846097c23fc tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:48:28.200919 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-1d49faf2-39d3-4d7e-8f0f-e846097c23fc tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:28.206701 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-1d49faf2-39d3-4d7e-8f0f-e846097c23fc tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:28.262476 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-1d49faf2-39d3-4d7e-8f0f-e846097c23fc tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Going to try to stop instance {{(pid=124669) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 23 11:48:28.428314 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-1d49faf2-39d3-4d7e-8f0f-e846097c23fc tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "POST /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200/action" status: 202 len: 0 microversion: 2.1 time: 0.237913 Jun 23 11:48:28.429581 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 234/501] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Jun 23 11:48:28 2022] POST /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 11:48:28.437543 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-698ccbef-dec6-4f32-8a94-780c92bd7d90 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:48:28.438412 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-698ccbef-dec6-4f32-8a94-780c92bd7d90 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:48:28.444590 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-698ccbef-dec6-4f32-8a94-780c92bd7d90 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:28.445126 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-698ccbef-dec6-4f32-8a94-780c92bd7d90 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:28.445896 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-698ccbef-dec6-4f32-8a94-780c92bd7d90 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:28.446326 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-698ccbef-dec6-4f32-8a94-780c92bd7d90 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:28.652066 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-698ccbef-dec6-4f32-8a94-780c92bd7d90 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:48:28.660337 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-698ccbef-dec6-4f32-8a94-780c92bd7d90 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 200 len: 1726 microversion: 2.1 time: 0.226569 Jun 23 11:48:28.660979 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 268/502] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:48:28 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 1726 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:48:28.973924 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-b79923d2-3792-4c5e-a72a-eb195a0c1df8 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:48:28.974478 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-b79923d2-3792-4c5e-a72a-eb195a0c1df8 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] [instance: a17006fa-d781-4551-a96c-1ca769325ae6] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:48:28.981069 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-b79923d2-3792-4c5e-a72a-eb195a0c1df8 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:28.981519 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-b79923d2-3792-4c5e-a72a-eb195a0c1df8 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:28.982288 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-b79923d2-3792-4c5e-a72a-eb195a0c1df8 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:28.982854 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-b79923d2-3792-4c5e-a72a-eb195a0c1df8 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:29.009899 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-b79923d2-3792-4c5e-a72a-eb195a0c1df8 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] [instance: a17006fa-d781-4551-a96c-1ca769325ae6] Going to try to terminate instance {{(pid=124669) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 11:48:29.016216 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [req-00fb80a7-5370-43eb-bc96-c38ce871aceb req-0be4b67a-2fba-42ea-b71b-3959638b6bec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76c7fe26-3425-4f59-8a7e-4281b4b6ed3f", "tag": "6c53408c-0865-4915-8148-5fd2f10f06a9"}]} {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:48:29.024932 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-00fb80a7-5370-43eb-bc96-c38ce871aceb req-0be4b67a-2fba-42ea-b71b-3959638b6bec service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:29.025647 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-00fb80a7-5370-43eb-bc96-c38ce871aceb req-0be4b67a-2fba-42ea-b71b-3959638b6bec service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:29.037402 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.compute.server_external_events [req-00fb80a7-5370-43eb-bc96-c38ce871aceb req-0be4b67a-2fba-42ea-b71b-3959638b6bec service nova] Creating event network-changed:6c53408c-0865-4915-8148-5fd2f10f06a9 for instance 76c7fe26-3425-4f59-8a7e-4281b4b6ed3f on hv-cinder-82099 Jun 23 11:48:29.043151 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [req-00fb80a7-5370-43eb-bc96-c38ce871aceb req-0be4b67a-2fba-42ea-b71b-3959638b6bec service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030542 Jun 23 11:48:29.044348 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 269/503] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:48:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:48:29.123574 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:48:29.287592 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-b79923d2-3792-4c5e-a72a-eb195a0c1df8 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a17006fa-d781-4551-a96c-1ca769325ae6" status: 204 len: 0 microversion: 2.1 time: 0.318110 Jun 23 11:48:29.289761 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 235/504] 10.222.0.13 () {58 vars in 1238 bytes} [Thu Jun 23 11:48:28 2022] DELETE /compute/v2.1/servers/a17006fa-d781-4551-a96c-1ca769325ae6 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 23 11:48:29.298462 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-1d87c2b8-8a3a-4377-a492-bc3464d4082f tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:48:29.299197 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-1d87c2b8-8a3a-4377-a492-bc3464d4082f tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] [instance: a17006fa-d781-4551-a96c-1ca769325ae6] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:48:29.306754 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1d87c2b8-8a3a-4377-a492-bc3464d4082f tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:29.307197 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1d87c2b8-8a3a-4377-a492-bc3464d4082f tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:29.308293 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1d87c2b8-8a3a-4377-a492-bc3464d4082f tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:29.308885 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1d87c2b8-8a3a-4377-a492-bc3464d4082f tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:29.442287 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-1d87c2b8-8a3a-4377-a492-bc3464d4082f tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0cc563017646f6acea9127f7f525ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2187f9489844ab8bbf1f69df83b2de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:48:29.450045 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-1d87c2b8-8a3a-4377-a492-bc3464d4082f tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] 10.222.0.13 "GET /compute/v2.1/servers/a17006fa-d781-4551-a96c-1ca769325ae6" status: 200 len: 1515 microversion: 2.1 time: 0.155831 Jun 23 11:48:29.450757 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 270/505] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:48:29 2022] GET /compute/v2.1/servers/a17006fa-d781-4551-a96c-1ca769325ae6 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:48:29.678122 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-c440cf03-383b-404a-a2c5-1bb7b4c78089 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:48:29.679098 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-c440cf03-383b-404a-a2c5-1bb7b4c78089 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:48:29.686044 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c440cf03-383b-404a-a2c5-1bb7b4c78089 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:29.686601 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c440cf03-383b-404a-a2c5-1bb7b4c78089 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:29.687644 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c440cf03-383b-404a-a2c5-1bb7b4c78089 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:29.688241 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c440cf03-383b-404a-a2c5-1bb7b4c78089 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:29.821843 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-c440cf03-383b-404a-a2c5-1bb7b4c78089 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:48:29.829912 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-c440cf03-383b-404a-a2c5-1bb7b4c78089 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 200 len: 1726 microversion: 2.1 time: 0.156018 Jun 23 11:48:29.830478 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 236/506] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:48:29 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:48:30.467505 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-eec51ade-263b-474e-bd45-0a6fa9b3dd4e tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:48:30.468110 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-eec51ade-263b-474e-bd45-0a6fa9b3dd4e tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] [instance: a17006fa-d781-4551-a96c-1ca769325ae6] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:48:30.474089 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-eec51ade-263b-474e-bd45-0a6fa9b3dd4e tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:30.474565 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-eec51ade-263b-474e-bd45-0a6fa9b3dd4e tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:30.475320 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-eec51ade-263b-474e-bd45-0a6fa9b3dd4e tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:30.475780 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-eec51ade-263b-474e-bd45-0a6fa9b3dd4e tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:30.613933 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-eec51ade-263b-474e-bd45-0a6fa9b3dd4e tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0cc563017646f6acea9127f7f525ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2187f9489844ab8bbf1f69df83b2de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:48:30.618130 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_cell1:SELECT=100 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:48:30.622420 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-eec51ade-263b-474e-bd45-0a6fa9b3dd4e tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] 10.222.0.13 "GET /compute/v2.1/servers/a17006fa-d781-4551-a96c-1ca769325ae6" status: 200 len: 1515 microversion: 2.1 time: 0.158750 Jun 23 11:48:30.623012 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 271/507] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:48:30 2022] GET /compute/v2.1/servers/a17006fa-d781-4551-a96c-1ca769325ae6 => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:48:30.847977 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-b991dce5-38d0-49b7-a3de-2bbaf96eb5f3 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:48:30.848588 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-b991dce5-38d0-49b7-a3de-2bbaf96eb5f3 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:48:30.855712 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-b991dce5-38d0-49b7-a3de-2bbaf96eb5f3 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:30.856163 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-b991dce5-38d0-49b7-a3de-2bbaf96eb5f3 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:30.856929 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-b991dce5-38d0-49b7-a3de-2bbaf96eb5f3 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:30.857365 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-b991dce5-38d0-49b7-a3de-2bbaf96eb5f3 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:31.060716 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-b991dce5-38d0-49b7-a3de-2bbaf96eb5f3 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:48:31.068736 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-b991dce5-38d0-49b7-a3de-2bbaf96eb5f3 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 200 len: 1726 microversion: 2.1 time: 0.224699 Jun 23 11:48:31.069239 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 237/508] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:48:30 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 1726 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:48:31.639479 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-20d72a65-dec6-4f48-9906-2807d758bff4 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:48:31.640522 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-20d72a65-dec6-4f48-9906-2807d758bff4 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] [instance: a17006fa-d781-4551-a96c-1ca769325ae6] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:48:31.647125 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-20d72a65-dec6-4f48-9906-2807d758bff4 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:31.648216 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-20d72a65-dec6-4f48-9906-2807d758bff4 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:31.649287 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-20d72a65-dec6-4f48-9906-2807d758bff4 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:31.649578 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-20d72a65-dec6-4f48-9906-2807d758bff4 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:31.860138 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-20d72a65-dec6-4f48-9906-2807d758bff4 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0cc563017646f6acea9127f7f525ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2187f9489844ab8bbf1f69df83b2de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:48:31.868156 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-20d72a65-dec6-4f48-9906-2807d758bff4 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] 10.222.0.13 "GET /compute/v2.1/servers/a17006fa-d781-4551-a96c-1ca769325ae6" status: 200 len: 1515 microversion: 2.1 time: 0.232649 Jun 23 11:48:31.868729 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 272/509] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:48:31 2022] GET /compute/v2.1/servers/a17006fa-d781-4551-a96c-1ca769325ae6 => generated 1515 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:48:32.049174 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [req-bb9a7898-8397-4656-a738-02e01d110227 req-48294e42-5f71-4996-bc12-57461251b3ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a17006fa-d781-4551-a96c-1ca769325ae6", "name": "network-vif-deleted", "tag": "1796d8a3-7f26-4cbc-8fbf-966361d393ae"}]} {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:48:32.058867 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [req-bb9a7898-8397-4656-a738-02e01d110227 req-48294e42-5f71-4996-bc12-57461251b3ee service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:32.059307 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [req-bb9a7898-8397-4656-a738-02e01d110227 req-48294e42-5f71-4996-bc12-57461251b3ee service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:32.070718 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.compute.server_external_events [req-bb9a7898-8397-4656-a738-02e01d110227 req-48294e42-5f71-4996-bc12-57461251b3ee service nova] Creating event network-vif-deleted:1796d8a3-7f26-4cbc-8fbf-966361d393ae for instance a17006fa-d781-4551-a96c-1ca769325ae6 on hv-cinder-82099 Jun 23 11:48:32.075474 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [req-bb9a7898-8397-4656-a738-02e01d110227 req-48294e42-5f71-4996-bc12-57461251b3ee service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030927 Jun 23 11:48:32.076045 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 238/510] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:48:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:48:32.086341 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-6e49dc88-9c10-4e2b-af2b-cb5743aea98c tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:48:32.088139 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-6e49dc88-9c10-4e2b-af2b-cb5743aea98c tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:48:32.093313 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-6e49dc88-9c10-4e2b-af2b-cb5743aea98c tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:32.093757 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-6e49dc88-9c10-4e2b-af2b-cb5743aea98c tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:32.094514 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-6e49dc88-9c10-4e2b-af2b-cb5743aea98c tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:32.094982 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-6e49dc88-9c10-4e2b-af2b-cb5743aea98c tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:32.224190 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-6e49dc88-9c10-4e2b-af2b-cb5743aea98c tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:48:32.233247 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-6e49dc88-9c10-4e2b-af2b-cb5743aea98c tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 200 len: 1726 microversion: 2.1 time: 0.151374 Jun 23 11:48:32.233820 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 273/511] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:48:32 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:48:32.885821 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-c87a182f-2fc5-4d18-b783-649077e7de6e tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:48:32.886506 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-c87a182f-2fc5-4d18-b783-649077e7de6e tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] [instance: a17006fa-d781-4551-a96c-1ca769325ae6] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:48:32.892581 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c87a182f-2fc5-4d18-b783-649077e7de6e tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:32.893028 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c87a182f-2fc5-4d18-b783-649077e7de6e tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:32.893775 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c87a182f-2fc5-4d18-b783-649077e7de6e tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:32.894202 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c87a182f-2fc5-4d18-b783-649077e7de6e tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:32.924564 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c87a182f-2fc5-4d18-b783-649077e7de6e tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:32.925019 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c87a182f-2fc5-4d18-b783-649077e7de6e tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:32.925450 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.objects.instance [None req-c87a182f-2fc5-4d18-b783-649077e7de6e tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lazy-loading 'fault' on Instance uuid a17006fa-d781-4551-a96c-1ca769325ae6 {{(pid=124669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:48:32.975211 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-c87a182f-2fc5-4d18-b783-649077e7de6e tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0cc563017646f6acea9127f7f525ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2187f9489844ab8bbf1f69df83b2de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:48:32.983893 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-c87a182f-2fc5-4d18-b783-649077e7de6e tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] 10.222.0.13 "GET /compute/v2.1/servers/a17006fa-d781-4551-a96c-1ca769325ae6" status: 200 len: 1309 microversion: 2.1 time: 0.102440 Jun 23 11:48:32.984589 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 239/512] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:48:32 2022] GET /compute/v2.1/servers/a17006fa-d781-4551-a96c-1ca769325ae6 => generated 1309 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:48:33.250781 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-eec3ecfb-4318-4dd3-8662-fca4106d5dfd tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:48:33.251457 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-eec3ecfb-4318-4dd3-8662-fca4106d5dfd tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:48:33.257362 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-eec3ecfb-4318-4dd3-8662-fca4106d5dfd tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:33.257805 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-eec3ecfb-4318-4dd3-8662-fca4106d5dfd tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:33.259659 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-eec3ecfb-4318-4dd3-8662-fca4106d5dfd tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:33.260113 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-eec3ecfb-4318-4dd3-8662-fca4106d5dfd tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:33.385523 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-eec3ecfb-4318-4dd3-8662-fca4106d5dfd tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:48:33.394275 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-eec3ecfb-4318-4dd3-8662-fca4106d5dfd tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 200 len: 1726 microversion: 2.1 time: 0.147368 Jun 23 11:48:33.394874 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 274/513] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:48:33 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 1726 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:48:34.001108 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-a397c7b4-5685-4c4f-bc5c-335cbc46cd78 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:48:34.001819 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-a397c7b4-5685-4c4f-bc5c-335cbc46cd78 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] [instance: a17006fa-d781-4551-a96c-1ca769325ae6] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:48:34.008667 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-a397c7b4-5685-4c4f-bc5c-335cbc46cd78 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:34.009238 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-a397c7b4-5685-4c4f-bc5c-335cbc46cd78 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:34.010005 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-a397c7b4-5685-4c4f-bc5c-335cbc46cd78 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:34.010441 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-a397c7b4-5685-4c4f-bc5c-335cbc46cd78 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:34.024397 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.wsgi [None req-a397c7b4-5685-4c4f-bc5c-335cbc46cd78 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] HTTP exception thrown: Instance a17006fa-d781-4551-a96c-1ca769325ae6 could not be found. Jun 23 11:48:34.026045 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-a397c7b4-5685-4c4f-bc5c-335cbc46cd78 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Request method failure captured: Jun 23 11:48:34.026045 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: request: GET /compute/v2.1/servers/a17006fa-d781-4551-a96c-1ca769325ae6 HTTP/1.1 Jun 23 11:48:34.026045 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Accept: application/json Jun 23 11:48:34.026045 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Accept-Encoding: identity Jun 23 11:48:34.026045 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Connection: close Jun 23 11:48:34.026045 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Content-Length: 0 Jun 23 11:48:34.026045 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Content-Type: application/json Jun 23 11:48:34.026045 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Host: 10.222.0.13 Jun 23 11:48:34.026045 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Openstack-System-Scope: None Jun 23 11:48:34.026045 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: User-Agent: python-urllib3/1.26.9 Jun 23 11:48:34.026045 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Auth-Token: gAAAAABitFKkKJt8qFDBnXZo9xyduqnp5He-00GSqFlDcD3i4aqs9ASURPdh_Lt4Z7amtNp99QnpTD2ediDK1s7bKPMIATMXHtn7l5Y1iAeKldeCC3Rk_S6idnG0o3m2td7v7z91ejp0AIyvv8hdtprFP1aB8S2DqS8l6BedX3Y-kniGAfM1iLE Jun 23 11:48:34.026045 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Domain-Id: None Jun 23 11:48:34.026045 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Domain-Name: None Jun 23 11:48:34.026045 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Identity-Status: Confirmed Jun 23 11:48:34.026045 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Is-Admin-Project: True Jun 23 11:48:34.026045 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Domain-Id: default Jun 23 11:48:34.026045 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Domain-Name: Default Jun 23 11:48:34.026045 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Id: eb2187f9489844ab8bbf1f69df83b2de Jun 23 11:48:34.026045 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1522463724 Jun 23 11:48:34.026045 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Role: member,reader Jun 23 11:48:34.026045 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Roles: member,reader Jun 23 11:48:34.027666 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_eb2187f9489844ab8bbf1f69df83b2de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/eb2187f9489844ab8bbf1f69df83b2de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/eb2187f9489844ab8bbf1f69df83b2de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/eb2187f9489844ab8bbf1f69df83b2de"}]}] Jun 23 11:48:34.027666 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant: tempest-VolumesSnapshotTestJSON-1522463724 Jun 23 11:48:34.027666 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant-Id: eb2187f9489844ab8bbf1f69df83b2de Jun 23 11:48:34.027666 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1522463724 Jun 23 11:48:34.027666 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User: tempest-VolumesSnapshotTestJSON-1522463724-project Jun 23 11:48:34.027666 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Domain-Id: default Jun 23 11:48:34.027666 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Domain-Name: Default Jun 23 11:48:34.027666 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Id: 5e0cc563017646f6acea9127f7f525ee Jun 23 11:48:34.027666 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Name: tempest-VolumesSnapshotTestJSON-1522463724-project Jun 23 11:48:34.027666 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: method: > Jun 23 11:48:34.027666 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: exception: Instance a17006fa-d781-4551-a96c-1ca769325ae6 could not be found. Jun 23 11:48:34.027666 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: action_args: {'id': 'a17006fa-d781-4551-a96c-1ca769325ae6'} Jun 23 11:48:34.028595 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:48:34.028595 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:48:34.028595 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:48:34.028595 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:48:34.028595 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:48:34.028595 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:48:34.028595 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:48:34.028595 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:48:34.028595 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:48:34.028595 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:48:34.028595 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a17006fa-d781-4551-a96c-1ca769325ae6 could not be found. Jun 23 11:48:34.028595 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:48:34.028595 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:48:34.028595 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:48:34.028595 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:48:34.028595 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:48:34.028595 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:48:34.028595 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:48:34.028595 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:48:34.028595 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:48:34.030027 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:48:34.030027 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 11:48:34.030027 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 11:48:34.030027 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:48:34.030027 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:48:34.030027 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:48:34.030027 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:48:34.030027 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a17006fa-d781-4551-a96c-1ca769325ae6 could not be found. Jun 23 11:48:34.030027 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:48:34.030027 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:48:34.030027 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:48:34.030027 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:48:34.030027 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:48:34.030027 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:48:34.030027 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:48:34.030027 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:48:34.030027 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a17006fa-d781-4551-a96c-1ca769325ae6 could not be found. Jun 23 11:48:34.030027 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:48:34.031235 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-a397c7b4-5685-4c4f-bc5c-335cbc46cd78 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Returning 404 to user: Instance a17006fa-d781-4551-a96c-1ca769325ae6 could not be found. {{(pid=124669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:48:34.031235 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-a397c7b4-5685-4c4f-bc5c-335cbc46cd78 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] 10.222.0.13 "GET /compute/v2.1/servers/a17006fa-d781-4551-a96c-1ca769325ae6" status: 404 len: 111 microversion: 2.1 time: 0.030371 Jun 23 11:48:34.031235 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 240/514] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:48:33 2022] GET /compute/v2.1/servers/a17006fa-d781-4551-a96c-1ca769325ae6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:48:34.412060 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-bb652182-b9ab-470c-8b12-ef6fb9ea5bb9 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:48:34.412644 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-bb652182-b9ab-470c-8b12-ef6fb9ea5bb9 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:48:34.419732 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-bb652182-b9ab-470c-8b12-ef6fb9ea5bb9 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:34.420173 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-bb652182-b9ab-470c-8b12-ef6fb9ea5bb9 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:34.420917 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-bb652182-b9ab-470c-8b12-ef6fb9ea5bb9 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:34.421342 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-bb652182-b9ab-470c-8b12-ef6fb9ea5bb9 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:34.557554 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-bb652182-b9ab-470c-8b12-ef6fb9ea5bb9 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:48:34.565761 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-bb652182-b9ab-470c-8b12-ef6fb9ea5bb9 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 200 len: 1726 microversion: 2.1 time: 0.157543 Jun 23 11:48:34.566325 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 275/515] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:48:34 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:48:35.582887 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-d8b65397-40b8-454d-9388-83b0fbaf6ad0 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:48:35.583527 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-d8b65397-40b8-454d-9388-83b0fbaf6ad0 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:48:35.590189 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-d8b65397-40b8-454d-9388-83b0fbaf6ad0 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:35.590667 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-d8b65397-40b8-454d-9388-83b0fbaf6ad0 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:35.591410 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-d8b65397-40b8-454d-9388-83b0fbaf6ad0 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:35.591840 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-d8b65397-40b8-454d-9388-83b0fbaf6ad0 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:35.720136 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-d8b65397-40b8-454d-9388-83b0fbaf6ad0 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:48:35.728559 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-d8b65397-40b8-454d-9388-83b0fbaf6ad0 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 200 len: 1726 microversion: 2.1 time: 0.148991 Jun 23 11:48:35.729535 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 241/516] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:48:35 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 1726 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:48:36.745144 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-b58af718-e77a-46fe-b62b-835a4a568a46 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:48:36.745703 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-b58af718-e77a-46fe-b62b-835a4a568a46 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:48:36.751755 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-b58af718-e77a-46fe-b62b-835a4a568a46 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:36.752198 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-b58af718-e77a-46fe-b62b-835a4a568a46 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:36.752939 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-b58af718-e77a-46fe-b62b-835a4a568a46 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:36.753369 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-b58af718-e77a-46fe-b62b-835a4a568a46 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:36.877572 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-b58af718-e77a-46fe-b62b-835a4a568a46 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:48:36.885588 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-b58af718-e77a-46fe-b62b-835a4a568a46 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 200 len: 1726 microversion: 2.1 time: 0.144368 Jun 23 11:48:36.886427 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 276/517] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:48:36 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 1726 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:48:37.903098 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-30f191c4-9247-489f-897a-9e963aab5f05 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:48:37.903718 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-30f191c4-9247-489f-897a-9e963aab5f05 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:48:37.906225 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:48:37.911099 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-30f191c4-9247-489f-897a-9e963aab5f05 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:37.911560 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-30f191c4-9247-489f-897a-9e963aab5f05 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:37.912322 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-30f191c4-9247-489f-897a-9e963aab5f05 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:37.912760 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-30f191c4-9247-489f-897a-9e963aab5f05 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:38.058716 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-30f191c4-9247-489f-897a-9e963aab5f05 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:48:38.067291 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-30f191c4-9247-489f-897a-9e963aab5f05 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 200 len: 1726 microversion: 2.1 time: 0.168604 Jun 23 11:48:38.068075 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 242/518] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:48:37 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 1726 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:48:39.085057 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-cc06003a-a8ac-48d3-bfc7-566854a0e8b6 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:48:39.085658 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-cc06003a-a8ac-48d3-bfc7-566854a0e8b6 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:48:39.087603 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_api:SELECT=46 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:48:39.093243 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-cc06003a-a8ac-48d3-bfc7-566854a0e8b6 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:39.093689 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-cc06003a-a8ac-48d3-bfc7-566854a0e8b6 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:39.094443 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-cc06003a-a8ac-48d3-bfc7-566854a0e8b6 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:39.094904 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-cc06003a-a8ac-48d3-bfc7-566854a0e8b6 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:39.222651 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-cc06003a-a8ac-48d3-bfc7-566854a0e8b6 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:48:39.230772 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-cc06003a-a8ac-48d3-bfc7-566854a0e8b6 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 200 len: 1726 microversion: 2.1 time: 0.149367 Jun 23 11:48:39.231334 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 277/519] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:48:39 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 1726 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:48:40.247518 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-55288916-5bee-4a02-b96d-d409dabe514d tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:48:40.248125 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-55288916-5bee-4a02-b96d-d409dabe514d tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:48:40.254724 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-55288916-5bee-4a02-b96d-d409dabe514d tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:40.255118 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-55288916-5bee-4a02-b96d-d409dabe514d tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:40.255874 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-55288916-5bee-4a02-b96d-d409dabe514d tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:40.256303 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-55288916-5bee-4a02-b96d-d409dabe514d tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:40.384880 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-55288916-5bee-4a02-b96d-d409dabe514d tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:48:40.393965 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-55288916-5bee-4a02-b96d-d409dabe514d tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 200 len: 1726 microversion: 2.1 time: 0.150358 Jun 23 11:48:40.394543 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 243/520] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:48:40 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:48:41.417193 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-7770098f-70fa-47d8-816b-7ba8af3b4d4d tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:48:41.417806 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-7770098f-70fa-47d8-816b-7ba8af3b4d4d tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:48:41.428478 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-7770098f-70fa-47d8-816b-7ba8af3b4d4d tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:41.428478 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-7770098f-70fa-47d8-816b-7ba8af3b4d4d tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:41.428478 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-7770098f-70fa-47d8-816b-7ba8af3b4d4d tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:41.428478 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-7770098f-70fa-47d8-816b-7ba8af3b4d4d tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:41.563833 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-7770098f-70fa-47d8-816b-7ba8af3b4d4d tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:48:41.572106 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-7770098f-70fa-47d8-816b-7ba8af3b4d4d tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 200 len: 1726 microversion: 2.1 time: 0.158705 Jun 23 11:48:41.572665 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 278/521] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:48:41 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:48:42.589526 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-38b26741-c8c8-4445-bc52-ce022c3a45da tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:48:42.590137 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-38b26741-c8c8-4445-bc52-ce022c3a45da tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:48:42.597022 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-38b26741-c8c8-4445-bc52-ce022c3a45da tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:42.597468 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-38b26741-c8c8-4445-bc52-ce022c3a45da tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:42.598217 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-38b26741-c8c8-4445-bc52-ce022c3a45da tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:42.598673 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-38b26741-c8c8-4445-bc52-ce022c3a45da tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:42.725718 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-38b26741-c8c8-4445-bc52-ce022c3a45da tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:48:42.734052 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-38b26741-c8c8-4445-bc52-ce022c3a45da tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 200 len: 1726 microversion: 2.1 time: 0.148553 Jun 23 11:48:42.737689 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 244/522] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:48:42 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 1726 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:48:43.751955 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-9172222c-427e-493c-a0e8-4f373cb0e8d5 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:48:43.752475 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-9172222c-427e-493c-a0e8-4f373cb0e8d5 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:48:43.758613 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-9172222c-427e-493c-a0e8-4f373cb0e8d5 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:43.759053 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-9172222c-427e-493c-a0e8-4f373cb0e8d5 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:43.759795 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-9172222c-427e-493c-a0e8-4f373cb0e8d5 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:43.760228 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-9172222c-427e-493c-a0e8-4f373cb0e8d5 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:43.906602 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-9172222c-427e-493c-a0e8-4f373cb0e8d5 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:48:43.914872 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-9172222c-427e-493c-a0e8-4f373cb0e8d5 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 200 len: 1726 microversion: 2.1 time: 0.168295 Jun 23 11:48:43.915432 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 279/523] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:48:43 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 1726 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:48:44.931362 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-bdf344cd-b148-4586-b7cd-a58e91909eab tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:48:44.931995 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-bdf344cd-b148-4586-b7cd-a58e91909eab tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:48:44.938762 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-bdf344cd-b148-4586-b7cd-a58e91909eab tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:44.939204 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-bdf344cd-b148-4586-b7cd-a58e91909eab tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:44.939948 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-bdf344cd-b148-4586-b7cd-a58e91909eab tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:44.940377 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-bdf344cd-b148-4586-b7cd-a58e91909eab tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:45.068959 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-bdf344cd-b148-4586-b7cd-a58e91909eab tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:48:45.077632 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-bdf344cd-b148-4586-b7cd-a58e91909eab tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 200 len: 1726 microversion: 2.1 time: 0.150075 Jun 23 11:48:45.078189 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 245/524] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:48:44 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 1726 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:48:46.094471 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-cd869db4-5c9a-4ea0-9b79-c5c2b406110a tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:48:46.095098 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-cd869db4-5c9a-4ea0-9b79-c5c2b406110a tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:48:46.101125 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-cd869db4-5c9a-4ea0-9b79-c5c2b406110a tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:46.101562 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-cd869db4-5c9a-4ea0-9b79-c5c2b406110a tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:46.102308 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-cd869db4-5c9a-4ea0-9b79-c5c2b406110a tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:46.102773 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-cd869db4-5c9a-4ea0-9b79-c5c2b406110a tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:46.230765 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-cd869db4-5c9a-4ea0-9b79-c5c2b406110a tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:48:46.239186 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-cd869db4-5c9a-4ea0-9b79-c5c2b406110a tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 200 len: 1703 microversion: 2.1 time: 0.149199 Jun 23 11:48:46.239752 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 280/525] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:48:46 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 1703 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:48:46.255518 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-209d9917-7b78-47c9-a99a-9d5779b4e556 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:48:46.261980 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-209d9917-7b78-47c9-a99a-9d5779b4e556 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:46.262430 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-209d9917-7b78-47c9-a99a-9d5779b4e556 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:46.285207 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-209d9917-7b78-47c9-a99a-9d5779b4e556 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Going to try to start instance {{(pid=124669) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 23 11:48:46.416786 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-209d9917-7b78-47c9-a99a-9d5779b4e556 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "POST /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200/action" status: 202 len: 0 microversion: 2.1 time: 0.164931 Jun 23 11:48:46.417480 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 246/526] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Jun 23 11:48:46 2022] POST /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200/action => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 11:48:46.426418 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-9495a7c9-5dd4-426c-8880-2e97bb23b196 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:48:46.427692 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-9495a7c9-5dd4-426c-8880-2e97bb23b196 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:48:46.433700 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-9495a7c9-5dd4-426c-8880-2e97bb23b196 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:46.434142 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-9495a7c9-5dd4-426c-8880-2e97bb23b196 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:46.434936 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-9495a7c9-5dd4-426c-8880-2e97bb23b196 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:46.435365 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-9495a7c9-5dd4-426c-8880-2e97bb23b196 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:46.673969 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-b5b9edf4-fd36-4b66-956b-066bd7adb278 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1289526689", "imageRef": "b19d6f23-214c-4432-bee6-455978023759", "flavorRef": "452", "networks": [{"uuid": "62402104-c963-4205-b4ad-5070bee7bcb3"}]}} {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:48:46.726845 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.network.neutron [None req-b5b9edf4-fd36-4b66-956b-066bd7adb278 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] validate_networks() for [('62402104-c963-4205-b4ad-5070bee7bcb3', None, None, None, None, None)] {{(pid=124669) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 11:48:46.987186 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-9495a7c9-5dd4-426c-8880-2e97bb23b196 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:48:46.995400 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-9495a7c9-5dd4-426c-8880-2e97bb23b196 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 200 len: 1712 microversion: 2.1 time: 0.573113 Jun 23 11:48:46.996149 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 281/527] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:48:46 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 1712 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:48:47.388756 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.virt.hardware [None req-b5b9edf4-fd36-4b66-956b-066bd7adb278 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Flavor limits 0:0:0 {{(pid=124669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 11:48:47.389342 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.virt.hardware [None req-b5b9edf4-fd36-4b66-956b-066bd7adb278 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Image limits 0:0:0 {{(pid=124669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 11:48:47.390065 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.virt.hardware [None req-b5b9edf4-fd36-4b66-956b-066bd7adb278 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Flavor pref 0:0:0 {{(pid=124669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 11:48:47.390555 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.virt.hardware [None req-b5b9edf4-fd36-4b66-956b-066bd7adb278 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Image pref 0:0:0 {{(pid=124669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 11:48:47.390982 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.virt.hardware [None req-b5b9edf4-fd36-4b66-956b-066bd7adb278 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 11:48:47.401026 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-b5b9edf4-fd36-4b66-956b-066bd7adb278 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:47.401474 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-b5b9edf4-fd36-4b66-956b-066bd7adb278 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:47.402266 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-b5b9edf4-fd36-4b66-956b-066bd7adb278 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:47.402739 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-b5b9edf4-fd36-4b66-956b-066bd7adb278 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:47.419861 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.quota [None req-b5b9edf4-fd36-4b66-956b-066bd7adb278 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Getting quotas for project eb2187f9489844ab8bbf1f69df83b2de. Resources: {'cores', 'instances', 'ram'} {{(pid=124669) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:48:47.424509 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.quota [None req-b5b9edf4-fd36-4b66-956b-066bd7adb278 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Getting quotas for user 5e0cc563017646f6acea9127f7f525ee and project eb2187f9489844ab8bbf1f69df83b2de. Resources: {'cores', 'instances', 'ram'} {{(pid=124669) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:48:47.435722 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-b5b9edf4-fd36-4b66-956b-066bd7adb278 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Going to run 1 instances... {{(pid=124669) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 11:48:47.438147 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-b5b9edf4-fd36-4b66-956b-066bd7adb278 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] [instance: a1d17def-3652-4ad4-9b36-88a1982bf70f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b19d6f23-214c-4432-bee6-455978023759',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124669) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 11:48:47.598650 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-b5b9edf4-fd36-4b66-956b-066bd7adb278 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.929433 Jun 23 11:48:47.599296 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 247/528] 10.222.0.13 () {60 vars in 1146 bytes} [Thu Jun 23 11:48:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 931 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 23 11:48:47.609562 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-1c5fe8d3-0777-4424-b39c-64dd8a7affa1 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:48:47.610167 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-1c5fe8d3-0777-4424-b39c-64dd8a7affa1 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] [instance: a1d17def-3652-4ad4-9b36-88a1982bf70f] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:48:47.665104 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-1c5fe8d3-0777-4424-b39c-64dd8a7affa1 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0cc563017646f6acea9127f7f525ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2187f9489844ab8bbf1f69df83b2de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:48:47.672588 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-1c5fe8d3-0777-4424-b39c-64dd8a7affa1 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] 10.222.0.13 "GET /compute/v2.1/servers/a1d17def-3652-4ad4-9b36-88a1982bf70f" status: 200 len: 1219 microversion: 2.1 time: 0.067335 Jun 23 11:48:47.673183 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 282/529] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:48:47 2022] GET /compute/v2.1/servers/a1d17def-3652-4ad4-9b36-88a1982bf70f => generated 1219 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:48:48.018223 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-91679666-5b4c-4cd7-90e8-76beab3c791d tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:48:48.019220 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-91679666-5b4c-4cd7-90e8-76beab3c791d tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:48:48.025707 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-91679666-5b4c-4cd7-90e8-76beab3c791d tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:48.029961 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-91679666-5b4c-4cd7-90e8-76beab3c791d tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:48.029961 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-91679666-5b4c-4cd7-90e8-76beab3c791d tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:48.029961 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-91679666-5b4c-4cd7-90e8-76beab3c791d tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:48.160247 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-91679666-5b4c-4cd7-90e8-76beab3c791d tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:48:48.168423 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-91679666-5b4c-4cd7-90e8-76beab3c791d tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 200 len: 1712 microversion: 2.1 time: 0.155265 Jun 23 11:48:48.169427 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 248/530] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:48:48 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 1712 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:48:48.689936 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-b5398a34-70dc-4820-8802-f1fd091ab5aa tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:48:48.690583 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-b5398a34-70dc-4820-8802-f1fd091ab5aa tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] [instance: a1d17def-3652-4ad4-9b36-88a1982bf70f] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:48:48.696859 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-b5398a34-70dc-4820-8802-f1fd091ab5aa tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:48.697300 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-b5398a34-70dc-4820-8802-f1fd091ab5aa tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:48.698052 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-b5398a34-70dc-4820-8802-f1fd091ab5aa tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:48.698648 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-b5398a34-70dc-4820-8802-f1fd091ab5aa tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:48.759974 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-b5398a34-70dc-4820-8802-f1fd091ab5aa tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0cc563017646f6acea9127f7f525ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2187f9489844ab8bbf1f69df83b2de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:48:48.767333 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-b5398a34-70dc-4820-8802-f1fd091ab5aa tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] 10.222.0.13 "GET /compute/v2.1/servers/a1d17def-3652-4ad4-9b36-88a1982bf70f" status: 200 len: 1223 microversion: 2.1 time: 0.081911 Jun 23 11:48:48.767886 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 283/531] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:48:48 2022] GET /compute/v2.1/servers/a1d17def-3652-4ad4-9b36-88a1982bf70f => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:48:49.186145 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-48a04e83-2ed6-41a4-99e9-2fbc2d1f4a48 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:48:49.186842 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-48a04e83-2ed6-41a4-99e9-2fbc2d1f4a48 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:48:49.194926 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-48a04e83-2ed6-41a4-99e9-2fbc2d1f4a48 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:49.195442 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-48a04e83-2ed6-41a4-99e9-2fbc2d1f4a48 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:49.200743 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-48a04e83-2ed6-41a4-99e9-2fbc2d1f4a48 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:49.200743 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-48a04e83-2ed6-41a4-99e9-2fbc2d1f4a48 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:49.329233 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-48a04e83-2ed6-41a4-99e9-2fbc2d1f4a48 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:48:49.337208 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-48a04e83-2ed6-41a4-99e9-2fbc2d1f4a48 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 200 len: 1716 microversion: 2.1 time: 0.155102 Jun 23 11:48:49.337767 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 249/532] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:48:49 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 1716 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:48:49.784597 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-4259f4d6-8d9b-4002-9304-093dfd290895 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:48:49.785139 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-4259f4d6-8d9b-4002-9304-093dfd290895 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] [instance: a1d17def-3652-4ad4-9b36-88a1982bf70f] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:48:49.791120 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-4259f4d6-8d9b-4002-9304-093dfd290895 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:49.791563 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-4259f4d6-8d9b-4002-9304-093dfd290895 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:49.792305 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-4259f4d6-8d9b-4002-9304-093dfd290895 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:49.792734 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-4259f4d6-8d9b-4002-9304-093dfd290895 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:49.852381 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-4259f4d6-8d9b-4002-9304-093dfd290895 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0cc563017646f6acea9127f7f525ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2187f9489844ab8bbf1f69df83b2de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:48:49.859905 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-4259f4d6-8d9b-4002-9304-093dfd290895 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] 10.222.0.13 "GET /compute/v2.1/servers/a1d17def-3652-4ad4-9b36-88a1982bf70f" status: 200 len: 1271 microversion: 2.1 time: 0.079895 Jun 23 11:48:49.860454 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 284/533] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:48:49 2022] GET /compute/v2.1/servers/a1d17def-3652-4ad4-9b36-88a1982bf70f => generated 1271 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:48:50.908027 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-137b6ae2-63f9-4c46-8fad-804c41055890 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:48:50.908027 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-137b6ae2-63f9-4c46-8fad-804c41055890 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] [instance: a1d17def-3652-4ad4-9b36-88a1982bf70f] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:48:50.908027 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-137b6ae2-63f9-4c46-8fad-804c41055890 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:50.908027 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-137b6ae2-63f9-4c46-8fad-804c41055890 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:50.908719 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-137b6ae2-63f9-4c46-8fad-804c41055890 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:50.908719 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-137b6ae2-63f9-4c46-8fad-804c41055890 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:51.019038 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-137b6ae2-63f9-4c46-8fad-804c41055890 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0cc563017646f6acea9127f7f525ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2187f9489844ab8bbf1f69df83b2de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:48:51.026510 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-137b6ae2-63f9-4c46-8fad-804c41055890 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] 10.222.0.13 "GET /compute/v2.1/servers/a1d17def-3652-4ad4-9b36-88a1982bf70f" status: 200 len: 1319 microversion: 2.1 time: 0.154092 Jun 23 11:48:51.029289 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 250/534] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:48:50 2022] GET /compute/v2.1/servers/a1d17def-3652-4ad4-9b36-88a1982bf70f => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:48:51.828776 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [req-10b17d74-0f6f-4ae0-a269-3385c94d39fc req-f2e19948-e1f2-41dd-849d-73edfcdbf2e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1d17def-3652-4ad4-9b36-88a1982bf70f", "tag": "6396080a-5287-4fc0-976c-3d39892fc767"}]} {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:48:51.840376 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-10b17d74-0f6f-4ae0-a269-3385c94d39fc req-f2e19948-e1f2-41dd-849d-73edfcdbf2e5 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:51.840376 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-10b17d74-0f6f-4ae0-a269-3385c94d39fc req-f2e19948-e1f2-41dd-849d-73edfcdbf2e5 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:51.851574 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.compute.server_external_events [req-10b17d74-0f6f-4ae0-a269-3385c94d39fc req-f2e19948-e1f2-41dd-849d-73edfcdbf2e5 service nova] Creating event network-changed:6396080a-5287-4fc0-976c-3d39892fc767 for instance a1d17def-3652-4ad4-9b36-88a1982bf70f on hv-cinder-82099 Jun 23 11:48:51.856481 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [req-10b17d74-0f6f-4ae0-a269-3385c94d39fc req-f2e19948-e1f2-41dd-849d-73edfcdbf2e5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031476 Jun 23 11:48:51.857336 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 285/535] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:48:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:48:52.044190 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-cb82a2c9-3b28-48e9-9874-d5b59a18d6cc tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:48:52.044810 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-cb82a2c9-3b28-48e9-9874-d5b59a18d6cc tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] [instance: a1d17def-3652-4ad4-9b36-88a1982bf70f] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:48:52.051516 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-cb82a2c9-3b28-48e9-9874-d5b59a18d6cc tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:52.051966 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-cb82a2c9-3b28-48e9-9874-d5b59a18d6cc tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:52.052727 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-cb82a2c9-3b28-48e9-9874-d5b59a18d6cc tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:52.053164 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-cb82a2c9-3b28-48e9-9874-d5b59a18d6cc tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:52.230906 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-cb82a2c9-3b28-48e9-9874-d5b59a18d6cc tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0cc563017646f6acea9127f7f525ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2187f9489844ab8bbf1f69df83b2de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:48:52.239026 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-cb82a2c9-3b28-48e9-9874-d5b59a18d6cc tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] 10.222.0.13 "GET /compute/v2.1/servers/a1d17def-3652-4ad4-9b36-88a1982bf70f" status: 200 len: 1319 microversion: 2.1 time: 0.198748 Jun 23 11:48:52.239595 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 251/536] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:48:52 2022] GET /compute/v2.1/servers/a1d17def-3652-4ad4-9b36-88a1982bf70f => generated 1319 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:48:53.256979 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-1c5b873b-b0aa-4f32-b347-c3bef3bd8663 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:48:53.257688 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-1c5b873b-b0aa-4f32-b347-c3bef3bd8663 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] [instance: a1d17def-3652-4ad4-9b36-88a1982bf70f] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:48:53.263920 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1c5b873b-b0aa-4f32-b347-c3bef3bd8663 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:53.264374 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1c5b873b-b0aa-4f32-b347-c3bef3bd8663 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:53.265122 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1c5b873b-b0aa-4f32-b347-c3bef3bd8663 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:53.265552 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1c5b873b-b0aa-4f32-b347-c3bef3bd8663 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:53.395319 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-1c5b873b-b0aa-4f32-b347-c3bef3bd8663 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0cc563017646f6acea9127f7f525ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2187f9489844ab8bbf1f69df83b2de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:48:53.402936 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-1c5b873b-b0aa-4f32-b347-c3bef3bd8663 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] 10.222.0.13 "GET /compute/v2.1/servers/a1d17def-3652-4ad4-9b36-88a1982bf70f" status: 200 len: 1319 microversion: 2.1 time: 0.150090 Jun 23 11:48:53.403501 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 286/537] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:48:53 2022] GET /compute/v2.1/servers/a1d17def-3652-4ad4-9b36-88a1982bf70f => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:48:53.582219 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-3b2e672e-223c-423b-b359-40038949bf33 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:48:53.582741 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-3b2e672e-223c-423b-b359-40038949bf33 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:48:53.589393 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-3b2e672e-223c-423b-b359-40038949bf33 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:53.589837 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-3b2e672e-223c-423b-b359-40038949bf33 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:53.590600 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-3b2e672e-223c-423b-b359-40038949bf33 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:53.591030 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-3b2e672e-223c-423b-b359-40038949bf33 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:53.614360 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-3b2e672e-223c-423b-b359-40038949bf33 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961/ips" status: 200 len: 152 microversion: 2.20 time: 0.035941 Jun 23 11:48:53.614946 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 252/538] 10.222.0.13 () {60 vars in 1288 bytes} [Thu Jun 23 11:48:53 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961/ips => generated 152 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 11:48:54.420245 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-80bd3895-bc51-48b9-8e73-6fe83787a045 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:48:54.420918 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-80bd3895-bc51-48b9-8e73-6fe83787a045 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] [instance: a1d17def-3652-4ad4-9b36-88a1982bf70f] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:48:54.426820 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-80bd3895-bc51-48b9-8e73-6fe83787a045 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:54.427269 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-80bd3895-bc51-48b9-8e73-6fe83787a045 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:54.428055 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-80bd3895-bc51-48b9-8e73-6fe83787a045 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:54.428492 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-80bd3895-bc51-48b9-8e73-6fe83787a045 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:54.555843 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-80bd3895-bc51-48b9-8e73-6fe83787a045 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0cc563017646f6acea9127f7f525ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2187f9489844ab8bbf1f69df83b2de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:48:54.564096 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-80bd3895-bc51-48b9-8e73-6fe83787a045 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] 10.222.0.13 "GET /compute/v2.1/servers/a1d17def-3652-4ad4-9b36-88a1982bf70f" status: 200 len: 1319 microversion: 2.1 time: 0.146905 Jun 23 11:48:54.564330 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 287/539] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:48:54 2022] GET /compute/v2.1/servers/a1d17def-3652-4ad4-9b36-88a1982bf70f => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:48:55.580978 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-99d9909d-8d4c-4b72-b422-b10e130dad36 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:48:55.581616 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-99d9909d-8d4c-4b72-b422-b10e130dad36 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] [instance: a1d17def-3652-4ad4-9b36-88a1982bf70f] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:48:55.588020 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-99d9909d-8d4c-4b72-b422-b10e130dad36 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:55.588464 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-99d9909d-8d4c-4b72-b422-b10e130dad36 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:55.589492 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-99d9909d-8d4c-4b72-b422-b10e130dad36 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:55.589922 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-99d9909d-8d4c-4b72-b422-b10e130dad36 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:55.593893 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:48:55.719975 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-99d9909d-8d4c-4b72-b422-b10e130dad36 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0cc563017646f6acea9127f7f525ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2187f9489844ab8bbf1f69df83b2de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:48:55.724079 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-99d9909d-8d4c-4b72-b422-b10e130dad36 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] 10.222.0.13 "GET /compute/v2.1/servers/a1d17def-3652-4ad4-9b36-88a1982bf70f" status: 200 len: 1319 microversion: 2.1 time: 0.147430 Jun 23 11:48:55.724634 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 253/540] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:48:55 2022] GET /compute/v2.1/servers/a1d17def-3652-4ad4-9b36-88a1982bf70f => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:48:56.740413 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-27eb1740-d7bd-4528-9823-fb5c4597bfbd tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:48:56.741010 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-27eb1740-d7bd-4528-9823-fb5c4597bfbd tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] [instance: a1d17def-3652-4ad4-9b36-88a1982bf70f] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:48:56.747033 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-27eb1740-d7bd-4528-9823-fb5c4597bfbd tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:56.747474 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-27eb1740-d7bd-4528-9823-fb5c4597bfbd tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:56.748220 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-27eb1740-d7bd-4528-9823-fb5c4597bfbd tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:56.748646 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-27eb1740-d7bd-4528-9823-fb5c4597bfbd tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:56.785541 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-8c969e7e-98df-49be-8619-9455f2fda074 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:48:56.786089 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-8c969e7e-98df-49be-8619-9455f2fda074 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:48:56.792562 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-8c969e7e-98df-49be-8619-9455f2fda074 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:56.793009 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-8c969e7e-98df-49be-8619-9455f2fda074 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:56.793763 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-8c969e7e-98df-49be-8619-9455f2fda074 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:56.794189 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-8c969e7e-98df-49be-8619-9455f2fda074 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:56.817192 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.objects.instance [None req-8c969e7e-98df-49be-8619-9455f2fda074 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lazy-loading 'flavor' on Instance uuid d9e98590-5036-4ade-bbba-f743256ac961 {{(pid=124669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:48:56.877708 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-27eb1740-d7bd-4528-9823-fb5c4597bfbd tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0cc563017646f6acea9127f7f525ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2187f9489844ab8bbf1f69df83b2de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:48:56.885248 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-27eb1740-d7bd-4528-9823-fb5c4597bfbd tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] 10.222.0.13 "GET /compute/v2.1/servers/a1d17def-3652-4ad4-9b36-88a1982bf70f" status: 200 len: 1319 microversion: 2.1 time: 0.148567 Jun 23 11:48:56.885831 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 288/541] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:48:56 2022] GET /compute/v2.1/servers/a1d17def-3652-4ad4-9b36-88a1982bf70f => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:48:57.320960 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-8c969e7e-98df-49be-8619-9455f2fda074 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "POST /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961/action" status: 202 len: 0 microversion: 2.20 time: 0.540240 Jun 23 11:48:57.321629 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 254/542] 10.222.0.13 () {62 vars in 1318 bytes} [Thu Jun 23 11:48:56 2022] POST /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961/action => generated 0 bytes in 542 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 23 11:48:57.330257 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-57383b06-d053-447c-b4bd-9ebbf475cd71 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:48:57.330893 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-57383b06-d053-447c-b4bd-9ebbf475cd71 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:48:57.337006 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-57383b06-d053-447c-b4bd-9ebbf475cd71 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:57.337454 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-57383b06-d053-447c-b4bd-9ebbf475cd71 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:57.338212 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-57383b06-d053-447c-b4bd-9ebbf475cd71 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:57.338670 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-57383b06-d053-447c-b4bd-9ebbf475cd71 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:57.468915 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-57383b06-d053-447c-b4bd-9ebbf475cd71 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:48:57.476799 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-57383b06-d053-447c-b4bd-9ebbf475cd71 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:48:57.478286 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-57383b06-d053-447c-b4bd-9ebbf475cd71 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:48:57.479446 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-57383b06-d053-447c-b4bd-9ebbf475cd71 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1720 microversion: 2.20 time: 0.153596 Jun 23 11:48:57.479991 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 289/543] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:48:57 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:48:57.899660 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_cell0:SELECT=2 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:48:57.900514 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_cell0:SELECT=6 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:48:57.905336 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-e241f9cd-6385-47bc-8848-7fddea306769 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:48:57.906133 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-e241f9cd-6385-47bc-8848-7fddea306769 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] [instance: a1d17def-3652-4ad4-9b36-88a1982bf70f] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:48:57.913265 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-e241f9cd-6385-47bc-8848-7fddea306769 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:57.913771 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-e241f9cd-6385-47bc-8848-7fddea306769 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:57.918690 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-e241f9cd-6385-47bc-8848-7fddea306769 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:57.918690 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-e241f9cd-6385-47bc-8848-7fddea306769 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:58.047450 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-e241f9cd-6385-47bc-8848-7fddea306769 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0cc563017646f6acea9127f7f525ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2187f9489844ab8bbf1f69df83b2de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:48:58.055663 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-e241f9cd-6385-47bc-8848-7fddea306769 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] 10.222.0.13 "GET /compute/v2.1/servers/a1d17def-3652-4ad4-9b36-88a1982bf70f" status: 200 len: 1319 microversion: 2.1 time: 0.156948 Jun 23 11:48:58.056227 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 255/544] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:48:57 2022] GET /compute/v2.1/servers/a1d17def-3652-4ad4-9b36-88a1982bf70f => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:48:58.497127 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-dc1a88cb-bcfd-49fd-abfe-74b071d542af tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:48:58.497930 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-dc1a88cb-bcfd-49fd-abfe-74b071d542af tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:48:58.499953 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_cell0:SELECT=2 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:48:58.504920 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-dc1a88cb-bcfd-49fd-abfe-74b071d542af tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:58.509967 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-dc1a88cb-bcfd-49fd-abfe-74b071d542af tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:58.509967 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-dc1a88cb-bcfd-49fd-abfe-74b071d542af tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:58.509967 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-dc1a88cb-bcfd-49fd-abfe-74b071d542af tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:58.510422 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_cell1:SELECT=100 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:48:58.632442 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-dc1a88cb-bcfd-49fd-abfe-74b071d542af tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:48:58.640242 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-dc1a88cb-bcfd-49fd-abfe-74b071d542af tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:48:58.645059 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-dc1a88cb-bcfd-49fd-abfe-74b071d542af tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:48:58.645059 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-dc1a88cb-bcfd-49fd-abfe-74b071d542af tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1720 microversion: 2.20 time: 0.150260 Jun 23 11:48:58.645059 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 290/545] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:48:58 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1720 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:48:59.072466 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-ea12fa93-d87d-4f24-9235-3851846a558b tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:48:59.073070 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-ea12fa93-d87d-4f24-9235-3851846a558b tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] [instance: a1d17def-3652-4ad4-9b36-88a1982bf70f] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:48:59.079704 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ea12fa93-d87d-4f24-9235-3851846a558b tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:59.080163 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ea12fa93-d87d-4f24-9235-3851846a558b tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:59.080913 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ea12fa93-d87d-4f24-9235-3851846a558b tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:59.081345 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ea12fa93-d87d-4f24-9235-3851846a558b tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:59.214789 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-ea12fa93-d87d-4f24-9235-3851846a558b tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0cc563017646f6acea9127f7f525ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2187f9489844ab8bbf1f69df83b2de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:48:59.223460 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-ea12fa93-d87d-4f24-9235-3851846a558b tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] 10.222.0.13 "GET /compute/v2.1/servers/a1d17def-3652-4ad4-9b36-88a1982bf70f" status: 200 len: 1319 microversion: 2.1 time: 0.154818 Jun 23 11:48:59.224049 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 256/546] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:48:59 2022] GET /compute/v2.1/servers/a1d17def-3652-4ad4-9b36-88a1982bf70f => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:48:59.366724 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [req-316ecdfc-3758-4a57-998f-c5e91b7ceb8e req-95ffec78-1eae-4557-9889-f43b0e6b3021 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1d17def-3652-4ad4-9b36-88a1982bf70f", "name": "network-vif-plugged", "status": "completed", "tag": "6396080a-5287-4fc0-976c-3d39892fc767"}]} {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:48:59.374899 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-316ecdfc-3758-4a57-998f-c5e91b7ceb8e req-95ffec78-1eae-4557-9889-f43b0e6b3021 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:59.375264 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-316ecdfc-3758-4a57-998f-c5e91b7ceb8e req-95ffec78-1eae-4557-9889-f43b0e6b3021 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:59.386600 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.compute.server_external_events [req-316ecdfc-3758-4a57-998f-c5e91b7ceb8e req-95ffec78-1eae-4557-9889-f43b0e6b3021 service nova] Creating event network-vif-plugged:6396080a-5287-4fc0-976c-3d39892fc767 for instance a1d17def-3652-4ad4-9b36-88a1982bf70f on hv-cinder-82099 Jun 23 11:48:59.391605 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [req-316ecdfc-3758-4a57-998f-c5e91b7ceb8e req-95ffec78-1eae-4557-9889-f43b0e6b3021 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028582 Jun 23 11:48:59.392870 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 291/547] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:48:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:48:59.663019 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-e8673953-3f3d-4f27-9077-fe1c0a488cb2 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:48:59.663658 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-e8673953-3f3d-4f27-9077-fe1c0a488cb2 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:48:59.670428 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-e8673953-3f3d-4f27-9077-fe1c0a488cb2 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:59.670960 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-e8673953-3f3d-4f27-9077-fe1c0a488cb2 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:59.671812 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-e8673953-3f3d-4f27-9077-fe1c0a488cb2 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:48:59.672329 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-e8673953-3f3d-4f27-9077-fe1c0a488cb2 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:48:59.853338 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-e8673953-3f3d-4f27-9077-fe1c0a488cb2 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:48:59.861812 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-e8673953-3f3d-4f27-9077-fe1c0a488cb2 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:48:59.863363 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-e8673953-3f3d-4f27-9077-fe1c0a488cb2 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:48:59.864509 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-e8673953-3f3d-4f27-9077-fe1c0a488cb2 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1720 microversion: 2.20 time: 0.207216 Jun 23 11:48:59.865049 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 257/548] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:48:59 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1720 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:49:00.241132 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-3a26d7f3-6825-40fa-a618-549a6d1e33c1 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:49:00.241827 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-3a26d7f3-6825-40fa-a618-549a6d1e33c1 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] [instance: a1d17def-3652-4ad4-9b36-88a1982bf70f] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:49:00.248082 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-3a26d7f3-6825-40fa-a618-549a6d1e33c1 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:00.248528 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-3a26d7f3-6825-40fa-a618-549a6d1e33c1 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:00.249340 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-3a26d7f3-6825-40fa-a618-549a6d1e33c1 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:00.249776 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-3a26d7f3-6825-40fa-a618-549a6d1e33c1 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:00.381193 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-3a26d7f3-6825-40fa-a618-549a6d1e33c1 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0cc563017646f6acea9127f7f525ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2187f9489844ab8bbf1f69df83b2de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:00.388577 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-3a26d7f3-6825-40fa-a618-549a6d1e33c1 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] 10.222.0.13 "GET /compute/v2.1/servers/a1d17def-3652-4ad4-9b36-88a1982bf70f" status: 200 len: 1319 microversion: 2.1 time: 0.151701 Jun 23 11:49:00.389138 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 292/549] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:49:00 2022] GET /compute/v2.1/servers/a1d17def-3652-4ad4-9b36-88a1982bf70f => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:49:00.882947 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-e26e63ee-d08a-4fee-bb7d-69da1630a3c1 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:49:00.883548 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-e26e63ee-d08a-4fee-bb7d-69da1630a3c1 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:49:00.889949 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-e26e63ee-d08a-4fee-bb7d-69da1630a3c1 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:00.890390 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-e26e63ee-d08a-4fee-bb7d-69da1630a3c1 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:00.891161 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-e26e63ee-d08a-4fee-bb7d-69da1630a3c1 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:00.891590 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-e26e63ee-d08a-4fee-bb7d-69da1630a3c1 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:01.015952 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-e26e63ee-d08a-4fee-bb7d-69da1630a3c1 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:01.024810 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-e26e63ee-d08a-4fee-bb7d-69da1630a3c1 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:01.026296 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-e26e63ee-d08a-4fee-bb7d-69da1630a3c1 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:01.027457 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-e26e63ee-d08a-4fee-bb7d-69da1630a3c1 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1720 microversion: 2.20 time: 0.148419 Jun 23 11:49:01.028014 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 258/550] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:49:00 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1720 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:49:01.404797 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-415f9221-67b9-47e3-ad90-45822769ebe2 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:49:01.405397 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-415f9221-67b9-47e3-ad90-45822769ebe2 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] [instance: a1d17def-3652-4ad4-9b36-88a1982bf70f] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:49:01.412115 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-415f9221-67b9-47e3-ad90-45822769ebe2 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:01.412580 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-415f9221-67b9-47e3-ad90-45822769ebe2 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:01.413334 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-415f9221-67b9-47e3-ad90-45822769ebe2 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:01.413764 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-415f9221-67b9-47e3-ad90-45822769ebe2 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:01.556297 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-415f9221-67b9-47e3-ad90-45822769ebe2 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0cc563017646f6acea9127f7f525ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2187f9489844ab8bbf1f69df83b2de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:01.563689 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-415f9221-67b9-47e3-ad90-45822769ebe2 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] 10.222.0.13 "GET /compute/v2.1/servers/a1d17def-3652-4ad4-9b36-88a1982bf70f" status: 200 len: 1319 microversion: 2.1 time: 0.162775 Jun 23 11:49:01.564867 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 293/551] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:49:01 2022] GET /compute/v2.1/servers/a1d17def-3652-4ad4-9b36-88a1982bf70f => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:49:02.045267 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-f3e34581-22f5-4e50-9991-c47672cc2862 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:49:02.045906 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-f3e34581-22f5-4e50-9991-c47672cc2862 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:49:02.052375 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-f3e34581-22f5-4e50-9991-c47672cc2862 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:02.052824 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-f3e34581-22f5-4e50-9991-c47672cc2862 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:02.053578 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-f3e34581-22f5-4e50-9991-c47672cc2862 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:02.054013 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-f3e34581-22f5-4e50-9991-c47672cc2862 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:02.181387 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-f3e34581-22f5-4e50-9991-c47672cc2862 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:02.189938 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-f3e34581-22f5-4e50-9991-c47672cc2862 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:02.191470 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-f3e34581-22f5-4e50-9991-c47672cc2862 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:02.192623 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-f3e34581-22f5-4e50-9991-c47672cc2862 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1720 microversion: 2.20 time: 0.151221 Jun 23 11:49:02.193170 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 259/552] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:49:02 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:49:02.580266 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-45dd35aa-6dd9-418a-bef2-34f8ad029359 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:49:02.580801 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-45dd35aa-6dd9-418a-bef2-34f8ad029359 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] [instance: a1d17def-3652-4ad4-9b36-88a1982bf70f] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:49:02.586908 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-45dd35aa-6dd9-418a-bef2-34f8ad029359 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:02.587359 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-45dd35aa-6dd9-418a-bef2-34f8ad029359 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:02.588121 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-45dd35aa-6dd9-418a-bef2-34f8ad029359 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:02.588557 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-45dd35aa-6dd9-418a-bef2-34f8ad029359 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:02.777201 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-45dd35aa-6dd9-418a-bef2-34f8ad029359 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0cc563017646f6acea9127f7f525ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2187f9489844ab8bbf1f69df83b2de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:02.787420 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-45dd35aa-6dd9-418a-bef2-34f8ad029359 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] 10.222.0.13 "GET /compute/v2.1/servers/a1d17def-3652-4ad4-9b36-88a1982bf70f" status: 200 len: 1508 microversion: 2.1 time: 0.211126 Jun 23 11:49:02.787975 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 294/553] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:49:02 2022] GET /compute/v2.1/servers/a1d17def-3652-4ad4-9b36-88a1982bf70f => generated 1508 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:49:02.803994 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-17e83880-2e98-4575-86ea-d5da1aabe34e tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f3e7a427-8bf0-4994-bba6-bb35214a2eaa", "device": "/dev/sdb"}} {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:49:02.805153 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-17e83880-2e98-4575-86ea-d5da1aabe34e tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] [instance: a1d17def-3652-4ad4-9b36-88a1982bf70f] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:49:02.811204 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-17e83880-2e98-4575-86ea-d5da1aabe34e tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:02.811654 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-17e83880-2e98-4575-86ea-d5da1aabe34e tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:02.812413 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-17e83880-2e98-4575-86ea-d5da1aabe34e tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:02.812852 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-17e83880-2e98-4575-86ea-d5da1aabe34e tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:03.211677 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-ed719330-2223-4583-96be-43ec3d69a78d tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:49:03.212225 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-ed719330-2223-4583-96be-43ec3d69a78d tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:49:03.218600 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-ed719330-2223-4583-96be-43ec3d69a78d tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:03.219049 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-ed719330-2223-4583-96be-43ec3d69a78d tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:03.219808 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-ed719330-2223-4583-96be-43ec3d69a78d tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:03.220418 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-ed719330-2223-4583-96be-43ec3d69a78d tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:03.348485 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-ed719330-2223-4583-96be-43ec3d69a78d tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:03.356428 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-ed719330-2223-4583-96be-43ec3d69a78d tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:03.357988 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-ed719330-2223-4583-96be-43ec3d69a78d tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:03.362787 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-ed719330-2223-4583-96be-43ec3d69a78d tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1720 microversion: 2.20 time: 0.151702 Jun 23 11:49:03.362787 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 295/554] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:49:03 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:49:03.418025 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-17e83880-2e98-4575-86ea-d5da1aabe34e tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] 10.222.0.13 "POST /compute/v2.1/servers/a1d17def-3652-4ad4-9b36-88a1982bf70f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.617753 Jun 23 11:49:03.418645 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 260/555] 10.222.0.13 () {60 vars in 1322 bytes} [Thu Jun 23 11:49:02 2022] POST /compute/v2.1/servers/a1d17def-3652-4ad4-9b36-88a1982bf70f/os-volume_attachments => generated 194 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:49:04.377570 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-6cac9a55-8e4a-413f-9e70-bee0ee4f400a tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:49:04.378168 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-6cac9a55-8e4a-413f-9e70-bee0ee4f400a tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:49:04.384150 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-6cac9a55-8e4a-413f-9e70-bee0ee4f400a tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:04.384592 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-6cac9a55-8e4a-413f-9e70-bee0ee4f400a tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:04.385335 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-6cac9a55-8e4a-413f-9e70-bee0ee4f400a tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:04.385764 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-6cac9a55-8e4a-413f-9e70-bee0ee4f400a tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:04.521373 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-6cac9a55-8e4a-413f-9e70-bee0ee4f400a tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:04.529291 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-6cac9a55-8e4a-413f-9e70-bee0ee4f400a tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:04.530825 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-6cac9a55-8e4a-413f-9e70-bee0ee4f400a tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:04.531975 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-6cac9a55-8e4a-413f-9e70-bee0ee4f400a tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1720 microversion: 2.20 time: 0.158660 Jun 23 11:49:04.532521 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 296/556] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:49:04 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:49:05.552240 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-eb869bc3-e9d7-4185-8cab-6d701da0c9a0 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:49:05.552936 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-eb869bc3-e9d7-4185-8cab-6d701da0c9a0 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:49:05.559128 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-eb869bc3-e9d7-4185-8cab-6d701da0c9a0 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:05.559576 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-eb869bc3-e9d7-4185-8cab-6d701da0c9a0 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:05.560338 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-eb869bc3-e9d7-4185-8cab-6d701da0c9a0 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:05.560774 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-eb869bc3-e9d7-4185-8cab-6d701da0c9a0 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:05.741624 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-eb869bc3-e9d7-4185-8cab-6d701da0c9a0 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:05.749516 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-eb869bc3-e9d7-4185-8cab-6d701da0c9a0 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:05.751043 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-eb869bc3-e9d7-4185-8cab-6d701da0c9a0 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:05.752324 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-eb869bc3-e9d7-4185-8cab-6d701da0c9a0 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1720 microversion: 2.20 time: 0.205641 Jun 23 11:49:05.752882 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 261/557] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:49:05 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1720 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:49:06.770885 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-e893fc35-651c-4766-8993-59f9bae8597e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:49:06.771456 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-e893fc35-651c-4766-8993-59f9bae8597e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:49:06.777549 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-e893fc35-651c-4766-8993-59f9bae8597e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:06.777998 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-e893fc35-651c-4766-8993-59f9bae8597e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:06.778779 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-e893fc35-651c-4766-8993-59f9bae8597e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:06.779218 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-e893fc35-651c-4766-8993-59f9bae8597e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:06.906345 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-e893fc35-651c-4766-8993-59f9bae8597e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:06.914342 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-e893fc35-651c-4766-8993-59f9bae8597e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:06.915887 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-e893fc35-651c-4766-8993-59f9bae8597e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:06.917045 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-e893fc35-651c-4766-8993-59f9bae8597e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1720 microversion: 2.20 time: 0.150667 Jun 23 11:49:06.917598 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 297/558] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:49:06 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:49:07.934276 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-8a1a3b71-c6f3-457e-b814-198ee552ae56 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:49:07.934830 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-8a1a3b71-c6f3-457e-b814-198ee552ae56 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:49:07.941472 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-8a1a3b71-c6f3-457e-b814-198ee552ae56 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:07.941923 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-8a1a3b71-c6f3-457e-b814-198ee552ae56 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:07.942727 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-8a1a3b71-c6f3-457e-b814-198ee552ae56 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:07.943165 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-8a1a3b71-c6f3-457e-b814-198ee552ae56 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:08.075055 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-8a1a3b71-c6f3-457e-b814-198ee552ae56 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:08.084085 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-8a1a3b71-c6f3-457e-b814-198ee552ae56 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:08.090073 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-8a1a3b71-c6f3-457e-b814-198ee552ae56 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:08.090073 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-8a1a3b71-c6f3-457e-b814-198ee552ae56 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1720 microversion: 2.20 time: 0.156442 Jun 23 11:49:08.090073 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 262/559] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:49:07 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:49:09.105887 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-db3e564a-e712-482d-90f3-d8da7c6c0126 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:49:09.106501 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-db3e564a-e712-482d-90f3-d8da7c6c0126 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:49:09.112963 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-db3e564a-e712-482d-90f3-d8da7c6c0126 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:09.113424 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-db3e564a-e712-482d-90f3-d8da7c6c0126 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:09.114188 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-db3e564a-e712-482d-90f3-d8da7c6c0126 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:09.114647 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-db3e564a-e712-482d-90f3-d8da7c6c0126 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:09.241446 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-db3e564a-e712-482d-90f3-d8da7c6c0126 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:09.249225 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-db3e564a-e712-482d-90f3-d8da7c6c0126 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:09.250736 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-db3e564a-e712-482d-90f3-d8da7c6c0126 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:09.252318 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-db3e564a-e712-482d-90f3-d8da7c6c0126 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1720 microversion: 2.20 time: 0.149926 Jun 23 11:49:09.252871 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 298/560] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:49:09 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:49:10.270347 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-5cd43798-ca02-45a5-b563-5875896062ab tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:49:10.270973 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-5cd43798-ca02-45a5-b563-5875896062ab tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:49:10.273379 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:49:10.278155 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-5cd43798-ca02-45a5-b563-5875896062ab tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:10.278645 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-5cd43798-ca02-45a5-b563-5875896062ab tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:10.279399 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-5cd43798-ca02-45a5-b563-5875896062ab tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:10.279830 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-5cd43798-ca02-45a5-b563-5875896062ab tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:10.408004 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-5cd43798-ca02-45a5-b563-5875896062ab tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:10.416989 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-5cd43798-ca02-45a5-b563-5875896062ab tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:10.418480 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-5cd43798-ca02-45a5-b563-5875896062ab tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:10.419670 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-5cd43798-ca02-45a5-b563-5875896062ab tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1720 microversion: 2.20 time: 0.153688 Jun 23 11:49:10.420224 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 263/561] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:49:10 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:49:10.835323 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 11:49:10.835803 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Thu Jun 23 11:49:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 11:49:11.438379 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-a0cc8f16-0723-4c4b-9a04-e3d5a9d7863c tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:49:11.438592 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-a0cc8f16-0723-4c4b-9a04-e3d5a9d7863c tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:49:11.442412 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_api:SELECT=46 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:49:11.446256 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a0cc8f16-0723-4c4b-9a04-e3d5a9d7863c tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:11.446803 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a0cc8f16-0723-4c4b-9a04-e3d5a9d7863c tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:11.447642 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a0cc8f16-0723-4c4b-9a04-e3d5a9d7863c tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:11.448147 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a0cc8f16-0723-4c4b-9a04-e3d5a9d7863c tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:11.832820 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-a0cc8f16-0723-4c4b-9a04-e3d5a9d7863c tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:11.841145 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-a0cc8f16-0723-4c4b-9a04-e3d5a9d7863c tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:11.846371 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-a0cc8f16-0723-4c4b-9a04-e3d5a9d7863c tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:11.846371 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-a0cc8f16-0723-4c4b-9a04-e3d5a9d7863c tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1741 microversion: 2.20 time: 0.410027 Jun 23 11:49:11.846371 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 299/562] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:49:11 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1741 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:49:12.862713 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-aeaab7e0-01ff-4875-82c1-4daebc404e20 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:49:12.863410 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-aeaab7e0-01ff-4875-82c1-4daebc404e20 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:49:12.870056 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-aeaab7e0-01ff-4875-82c1-4daebc404e20 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:12.870505 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-aeaab7e0-01ff-4875-82c1-4daebc404e20 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:12.871283 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-aeaab7e0-01ff-4875-82c1-4daebc404e20 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:12.871711 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-aeaab7e0-01ff-4875-82c1-4daebc404e20 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:13.001333 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-aeaab7e0-01ff-4875-82c1-4daebc404e20 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:13.010248 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-aeaab7e0-01ff-4875-82c1-4daebc404e20 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:13.011775 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-aeaab7e0-01ff-4875-82c1-4daebc404e20 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:13.013089 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-aeaab7e0-01ff-4875-82c1-4daebc404e20 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1741 microversion: 2.20 time: 0.154362 Jun 23 11:49:13.019443 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 264/563] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:49:12 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1741 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:49:13.351087 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [req-b0f39593-3795-4197-bb8a-3c2f4aa1143a req-260658a1-35d7-4176-ae1f-24a9e9e93eba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9e98590-5036-4ade-bbba-f743256ac961", "name": "network-vif-plugged", "status": "completed", "tag": "ff54d5bf-cdc7-493b-be07-f5ca28b2681b"}]} {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:49:13.359240 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-b0f39593-3795-4197-bb8a-3c2f4aa1143a req-260658a1-35d7-4176-ae1f-24a9e9e93eba service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:13.359679 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-b0f39593-3795-4197-bb8a-3c2f4aa1143a req-260658a1-35d7-4176-ae1f-24a9e9e93eba service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:13.373385 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.compute.server_external_events [req-b0f39593-3795-4197-bb8a-3c2f4aa1143a req-260658a1-35d7-4176-ae1f-24a9e9e93eba service nova] Creating event network-vif-plugged:ff54d5bf-cdc7-493b-be07-f5ca28b2681b for instance d9e98590-5036-4ade-bbba-f743256ac961 on hv-cinder-82099 Jun 23 11:49:13.375817 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [req-b0f39593-3795-4197-bb8a-3c2f4aa1143a req-260658a1-35d7-4176-ae1f-24a9e9e93eba service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028397 Jun 23 11:49:13.376386 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 300/564] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:49:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:49:14.036131 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-201f8e4e-6224-4623-a033-9861ae1016be tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:49:14.036744 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-201f8e4e-6224-4623-a033-9861ae1016be tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:49:14.044328 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-201f8e4e-6224-4623-a033-9861ae1016be tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:14.044812 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-201f8e4e-6224-4623-a033-9861ae1016be tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:14.045592 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-201f8e4e-6224-4623-a033-9861ae1016be tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:14.046032 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-201f8e4e-6224-4623-a033-9861ae1016be tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:14.250627 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-201f8e4e-6224-4623-a033-9861ae1016be tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:14.258622 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-201f8e4e-6224-4623-a033-9861ae1016be tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:14.260147 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-201f8e4e-6224-4623-a033-9861ae1016be tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:14.261341 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-201f8e4e-6224-4623-a033-9861ae1016be tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1741 microversion: 2.20 time: 0.229666 Jun 23 11:49:14.261901 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 265/565] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:49:14 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1741 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:49:15.280784 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-35ef6e3e-9f1a-4f22-a168-2e6e578b59aa tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:49:15.281499 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-35ef6e3e-9f1a-4f22-a168-2e6e578b59aa tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:49:15.289327 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-35ef6e3e-9f1a-4f22-a168-2e6e578b59aa tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:15.289778 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-35ef6e3e-9f1a-4f22-a168-2e6e578b59aa tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:15.290554 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-35ef6e3e-9f1a-4f22-a168-2e6e578b59aa tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:15.290993 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-35ef6e3e-9f1a-4f22-a168-2e6e578b59aa tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:15.418904 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-35ef6e3e-9f1a-4f22-a168-2e6e578b59aa tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:15.427633 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-35ef6e3e-9f1a-4f22-a168-2e6e578b59aa tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:15.429147 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-35ef6e3e-9f1a-4f22-a168-2e6e578b59aa tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:15.430297 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-35ef6e3e-9f1a-4f22-a168-2e6e578b59aa tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1741 microversion: 2.20 time: 0.153841 Jun 23 11:49:15.430888 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 301/566] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:49:15 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1741 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:49:16.448253 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-5f45b784-385b-4bbd-89e2-f0947ea9c780 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:49:16.448860 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-5f45b784-385b-4bbd-89e2-f0947ea9c780 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:49:16.455747 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-5f45b784-385b-4bbd-89e2-f0947ea9c780 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:16.456195 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-5f45b784-385b-4bbd-89e2-f0947ea9c780 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:16.456946 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-5f45b784-385b-4bbd-89e2-f0947ea9c780 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:16.457378 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-5f45b784-385b-4bbd-89e2-f0947ea9c780 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:16.478771 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:49:16.592510 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-5f45b784-385b-4bbd-89e2-f0947ea9c780 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:16.600769 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-5f45b784-385b-4bbd-89e2-f0947ea9c780 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:16.602255 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-5f45b784-385b-4bbd-89e2-f0947ea9c780 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:16.603458 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-5f45b784-385b-4bbd-89e2-f0947ea9c780 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1741 microversion: 2.20 time: 0.159077 Jun 23 11:49:16.604012 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 266/567] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:49:16 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1741 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:49:17.621802 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-35bccaf9-0228-42bf-b294-3750c9b65d6e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:49:17.622441 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-35bccaf9-0228-42bf-b294-3750c9b65d6e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:49:17.629083 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-35bccaf9-0228-42bf-b294-3750c9b65d6e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:17.629525 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-35bccaf9-0228-42bf-b294-3750c9b65d6e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:17.630280 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-35bccaf9-0228-42bf-b294-3750c9b65d6e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:17.630737 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-35bccaf9-0228-42bf-b294-3750c9b65d6e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:17.757673 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-35bccaf9-0228-42bf-b294-3750c9b65d6e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:17.765455 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-35bccaf9-0228-42bf-b294-3750c9b65d6e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:17.766996 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-35bccaf9-0228-42bf-b294-3750c9b65d6e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:17.769033 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-35bccaf9-0228-42bf-b294-3750c9b65d6e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1741 microversion: 2.20 time: 0.151163 Jun 23 11:49:17.769574 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 302/568] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:49:17 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1741 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:49:18.787825 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-0aa2a20f-8580-4986-b0e9-ba2a2e23c50c tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:49:18.788436 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-0aa2a20f-8580-4986-b0e9-ba2a2e23c50c tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:49:18.795019 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-0aa2a20f-8580-4986-b0e9-ba2a2e23c50c tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:18.795468 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-0aa2a20f-8580-4986-b0e9-ba2a2e23c50c tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:18.796226 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-0aa2a20f-8580-4986-b0e9-ba2a2e23c50c tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:18.796660 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-0aa2a20f-8580-4986-b0e9-ba2a2e23c50c tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:18.923293 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-0aa2a20f-8580-4986-b0e9-ba2a2e23c50c tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:18.931377 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-0aa2a20f-8580-4986-b0e9-ba2a2e23c50c tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:18.933081 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-0aa2a20f-8580-4986-b0e9-ba2a2e23c50c tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:18.934276 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-0aa2a20f-8580-4986-b0e9-ba2a2e23c50c tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1741 microversion: 2.20 time: 0.150936 Jun 23 11:49:18.934856 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 267/569] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:49:18 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1741 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:49:18.975992 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 11:49:18.976488 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Thu Jun 23 11:49:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 11:49:19.952908 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-6140b05c-a4d4-4f62-8f77-94d3c9756fe5 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:49:19.953503 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-6140b05c-a4d4-4f62-8f77-94d3c9756fe5 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:49:19.960071 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-6140b05c-a4d4-4f62-8f77-94d3c9756fe5 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:19.960509 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-6140b05c-a4d4-4f62-8f77-94d3c9756fe5 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:19.961253 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-6140b05c-a4d4-4f62-8f77-94d3c9756fe5 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:19.961678 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-6140b05c-a4d4-4f62-8f77-94d3c9756fe5 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:20.092565 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-6140b05c-a4d4-4f62-8f77-94d3c9756fe5 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:20.101562 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-6140b05c-a4d4-4f62-8f77-94d3c9756fe5 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:20.103106 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-6140b05c-a4d4-4f62-8f77-94d3c9756fe5 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:20.104240 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-6140b05c-a4d4-4f62-8f77-94d3c9756fe5 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1741 microversion: 2.20 time: 0.155260 Jun 23 11:49:20.104809 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 303/570] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:49:19 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1741 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:49:21.123050 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-8ed7cef0-bbce-4190-92bb-5c4b441a5931 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:49:21.123679 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-8ed7cef0-bbce-4190-92bb-5c4b441a5931 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:49:21.130909 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-8ed7cef0-bbce-4190-92bb-5c4b441a5931 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:21.131349 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-8ed7cef0-bbce-4190-92bb-5c4b441a5931 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:21.132128 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-8ed7cef0-bbce-4190-92bb-5c4b441a5931 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:21.132558 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-8ed7cef0-bbce-4190-92bb-5c4b441a5931 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:21.265411 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-8ed7cef0-bbce-4190-92bb-5c4b441a5931 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:21.273745 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-8ed7cef0-bbce-4190-92bb-5c4b441a5931 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:21.275280 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-8ed7cef0-bbce-4190-92bb-5c4b441a5931 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:21.276461 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-8ed7cef0-bbce-4190-92bb-5c4b441a5931 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1741 microversion: 2.20 time: 0.157215 Jun 23 11:49:21.277008 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 268/571] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:49:21 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1741 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:49:22.295587 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-b095873d-a74c-4d9a-804f-59e3d894feae tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:49:22.296196 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-b095873d-a74c-4d9a-804f-59e3d894feae tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:49:22.302697 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-b095873d-a74c-4d9a-804f-59e3d894feae tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:22.303149 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-b095873d-a74c-4d9a-804f-59e3d894feae tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:22.303901 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-b095873d-a74c-4d9a-804f-59e3d894feae tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:22.304330 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-b095873d-a74c-4d9a-804f-59e3d894feae tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:22.429697 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-b095873d-a74c-4d9a-804f-59e3d894feae tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:22.437439 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-b095873d-a74c-4d9a-804f-59e3d894feae tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:22.438968 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-b095873d-a74c-4d9a-804f-59e3d894feae tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:22.440352 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-b095873d-a74c-4d9a-804f-59e3d894feae tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1741 microversion: 2.20 time: 0.148640 Jun 23 11:49:22.440915 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 304/572] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:49:22 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1741 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:49:23.459406 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-e2566ca7-d4f9-4a0d-905b-40d0f6022bb4 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:49:23.460012 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-e2566ca7-d4f9-4a0d-905b-40d0f6022bb4 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:49:23.466732 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-e2566ca7-d4f9-4a0d-905b-40d0f6022bb4 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:23.467178 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-e2566ca7-d4f9-4a0d-905b-40d0f6022bb4 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:23.467925 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-e2566ca7-d4f9-4a0d-905b-40d0f6022bb4 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:23.468355 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-e2566ca7-d4f9-4a0d-905b-40d0f6022bb4 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:23.602449 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-e2566ca7-d4f9-4a0d-905b-40d0f6022bb4 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:23.610342 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-e2566ca7-d4f9-4a0d-905b-40d0f6022bb4 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:23.611951 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-e2566ca7-d4f9-4a0d-905b-40d0f6022bb4 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:23.613142 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-e2566ca7-d4f9-4a0d-905b-40d0f6022bb4 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1741 microversion: 2.20 time: 0.158768 Jun 23 11:49:23.613693 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 269/573] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:49:23 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1741 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:49:24.631204 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-c398e38c-40b3-473e-baed-c9ef9ac06319 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:49:24.631834 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-c398e38c-40b3-473e-baed-c9ef9ac06319 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:49:24.637838 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-c398e38c-40b3-473e-baed-c9ef9ac06319 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:24.638292 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-c398e38c-40b3-473e-baed-c9ef9ac06319 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:24.639067 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-c398e38c-40b3-473e-baed-c9ef9ac06319 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:24.639500 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-c398e38c-40b3-473e-baed-c9ef9ac06319 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:24.766916 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-c398e38c-40b3-473e-baed-c9ef9ac06319 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:24.775238 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-c398e38c-40b3-473e-baed-c9ef9ac06319 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:24.776748 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-c398e38c-40b3-473e-baed-c9ef9ac06319 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:24.777902 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-c398e38c-40b3-473e-baed-c9ef9ac06319 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1741 microversion: 2.20 time: 0.150645 Jun 23 11:49:24.778451 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 305/574] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:49:24 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1741 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:49:25.796648 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-0efee0b3-53c8-4c5d-9f49-bba2243d6b1a tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:49:25.797176 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-0efee0b3-53c8-4c5d-9f49-bba2243d6b1a tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:49:25.804308 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-0efee0b3-53c8-4c5d-9f49-bba2243d6b1a tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:25.804755 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-0efee0b3-53c8-4c5d-9f49-bba2243d6b1a tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:25.805498 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-0efee0b3-53c8-4c5d-9f49-bba2243d6b1a tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:25.805926 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-0efee0b3-53c8-4c5d-9f49-bba2243d6b1a tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:25.935649 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-0efee0b3-53c8-4c5d-9f49-bba2243d6b1a tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:25.944161 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-0efee0b3-53c8-4c5d-9f49-bba2243d6b1a tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:25.945688 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-0efee0b3-53c8-4c5d-9f49-bba2243d6b1a tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:25.946910 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-0efee0b3-53c8-4c5d-9f49-bba2243d6b1a tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1741 microversion: 2.20 time: 0.154180 Jun 23 11:49:25.950086 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 270/575] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:49:25 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1741 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:49:26.965624 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-e76ebfed-a0a0-4733-b17f-d5f6e83b9013 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:49:26.966483 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-e76ebfed-a0a0-4733-b17f-d5f6e83b9013 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:49:26.973265 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-e76ebfed-a0a0-4733-b17f-d5f6e83b9013 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:26.973717 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-e76ebfed-a0a0-4733-b17f-d5f6e83b9013 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:26.974478 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-e76ebfed-a0a0-4733-b17f-d5f6e83b9013 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:26.974943 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-e76ebfed-a0a0-4733-b17f-d5f6e83b9013 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:27.102895 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-e76ebfed-a0a0-4733-b17f-d5f6e83b9013 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:27.110792 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-e76ebfed-a0a0-4733-b17f-d5f6e83b9013 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:27.112651 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-e76ebfed-a0a0-4733-b17f-d5f6e83b9013 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:27.113878 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-e76ebfed-a0a0-4733-b17f-d5f6e83b9013 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1741 microversion: 2.20 time: 0.152160 Jun 23 11:49:27.114425 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 306/576] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:49:26 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1741 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:49:28.131626 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-11e574c5-ef9b-431f-9a98-1bdb3c372a18 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:49:28.132240 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-11e574c5-ef9b-431f-9a98-1bdb3c372a18 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:49:28.138823 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-11e574c5-ef9b-431f-9a98-1bdb3c372a18 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:28.139273 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-11e574c5-ef9b-431f-9a98-1bdb3c372a18 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:28.140042 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-11e574c5-ef9b-431f-9a98-1bdb3c372a18 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:28.140477 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-11e574c5-ef9b-431f-9a98-1bdb3c372a18 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:28.273615 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-11e574c5-ef9b-431f-9a98-1bdb3c372a18 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:28.281424 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-11e574c5-ef9b-431f-9a98-1bdb3c372a18 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:28.282983 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-11e574c5-ef9b-431f-9a98-1bdb3c372a18 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:28.284878 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-11e574c5-ef9b-431f-9a98-1bdb3c372a18 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1741 microversion: 2.20 time: 0.157734 Jun 23 11:49:28.285435 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 271/577] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:49:28 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1741 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:49:29.306731 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-8d8cce0d-c4bd-4059-a8ef-a035faf779d8 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:49:29.311150 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-8d8cce0d-c4bd-4059-a8ef-a035faf779d8 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:49:29.314720 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-8d8cce0d-c4bd-4059-a8ef-a035faf779d8 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:29.315187 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-8d8cce0d-c4bd-4059-a8ef-a035faf779d8 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:29.316641 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-8d8cce0d-c4bd-4059-a8ef-a035faf779d8 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:29.317318 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-8d8cce0d-c4bd-4059-a8ef-a035faf779d8 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:29.320376 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_cell1:SELECT=93 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:49:29.458069 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-8d8cce0d-c4bd-4059-a8ef-a035faf779d8 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:29.466520 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-8d8cce0d-c4bd-4059-a8ef-a035faf779d8 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:29.468109 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-8d8cce0d-c4bd-4059-a8ef-a035faf779d8 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:29.469330 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-8d8cce0d-c4bd-4059-a8ef-a035faf779d8 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1736 microversion: 2.20 time: 0.170506 Jun 23 11:49:29.469917 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 307/578] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:49:29 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1736 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:49:30.489636 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-7c531aa2-8c2c-488c-8d29-5073ae05b18a tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:49:30.491262 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-7c531aa2-8c2c-488c-8d29-5073ae05b18a tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:49:30.498740 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-7c531aa2-8c2c-488c-8d29-5073ae05b18a tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:30.499314 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-7c531aa2-8c2c-488c-8d29-5073ae05b18a tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:30.500335 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-7c531aa2-8c2c-488c-8d29-5073ae05b18a tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:30.500991 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-7c531aa2-8c2c-488c-8d29-5073ae05b18a tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:30.644218 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-7c531aa2-8c2c-488c-8d29-5073ae05b18a tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:30.651439 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-7c531aa2-8c2c-488c-8d29-5073ae05b18a tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:30.653647 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-7c531aa2-8c2c-488c-8d29-5073ae05b18a tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:30.654932 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-7c531aa2-8c2c-488c-8d29-5073ae05b18a tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1736 microversion: 2.20 time: 0.170520 Jun 23 11:49:30.656171 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 272/579] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:49:30 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1736 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:49:31.686922 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-ecb8f5aa-bb88-468e-be1b-ae720f9e433e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:49:31.687827 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-ecb8f5aa-bb88-468e-be1b-ae720f9e433e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:49:31.695707 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-ecb8f5aa-bb88-468e-be1b-ae720f9e433e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:31.696152 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-ecb8f5aa-bb88-468e-be1b-ae720f9e433e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:31.696910 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-ecb8f5aa-bb88-468e-be1b-ae720f9e433e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:31.697338 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-ecb8f5aa-bb88-468e-be1b-ae720f9e433e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:31.854505 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-ecb8f5aa-bb88-468e-be1b-ae720f9e433e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:31.862724 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-ecb8f5aa-bb88-468e-be1b-ae720f9e433e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:31.865180 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-ecb8f5aa-bb88-468e-be1b-ae720f9e433e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:31.866577 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-ecb8f5aa-bb88-468e-be1b-ae720f9e433e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1736 microversion: 2.20 time: 0.195741 Jun 23 11:49:31.872616 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 308/580] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:49:31 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1736 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:49:32.780797 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-ca611add-b13f-4abb-aca3-289707c8ff12 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:49:32.781289 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-ca611add-b13f-4abb-aca3-289707c8ff12 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] [instance: a1d17def-3652-4ad4-9b36-88a1982bf70f] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:49:32.788342 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ca611add-b13f-4abb-aca3-289707c8ff12 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:32.788798 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ca611add-b13f-4abb-aca3-289707c8ff12 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:32.789557 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ca611add-b13f-4abb-aca3-289707c8ff12 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:32.789998 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ca611add-b13f-4abb-aca3-289707c8ff12 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:32.872337 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.objects.instance [None req-ca611add-b13f-4abb-aca3-289707c8ff12 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lazy-loading 'services' on Instance uuid a1d17def-3652-4ad4-9b36-88a1982bf70f {{(pid=124669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:49:32.884882 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-d6e1c973-ca6c-4651-b373-3ed3dc23e7bc tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:49:32.885907 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-d6e1c973-ca6c-4651-b373-3ed3dc23e7bc tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:49:32.891896 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-d6e1c973-ca6c-4651-b373-3ed3dc23e7bc tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:32.892301 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-d6e1c973-ca6c-4651-b373-3ed3dc23e7bc tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:32.893075 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-d6e1c973-ca6c-4651-b373-3ed3dc23e7bc tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:32.893509 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-d6e1c973-ca6c-4651-b373-3ed3dc23e7bc tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:33.047993 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-d6e1c973-ca6c-4651-b373-3ed3dc23e7bc tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:33.058952 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-d6e1c973-ca6c-4651-b373-3ed3dc23e7bc tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:33.060883 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-d6e1c973-ca6c-4651-b373-3ed3dc23e7bc tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:33.062000 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-d6e1c973-ca6c-4651-b373-3ed3dc23e7bc tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1736 microversion: 2.20 time: 0.180995 Jun 23 11:49:33.063103 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 309/581] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:49:32 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1736 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:49:33.077871 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-ca611add-b13f-4abb-aca3-289707c8ff12 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a1d17def-3652-4ad4-9b36-88a1982bf70f/os-volume_attachments/f3e7a427-8bf0-4994-bba6-bb35214a2eaa" status: 202 len: 0 microversion: 2.1 time: 0.300823 Jun 23 11:49:33.078661 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 273/582] 10.222.0.13 () {58 vars in 1415 bytes} [Thu Jun 23 11:49:32 2022] DELETE /compute/v2.1/servers/a1d17def-3652-4ad4-9b36-88a1982bf70f/os-volume_attachments/f3e7a427-8bf0-4994-bba6-bb35214a2eaa => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 11:49:34.081624 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-59f1094b-94e1-4efa-a3a1-e3ed6a9b01a6 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:49:34.083376 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-59f1094b-94e1-4efa-a3a1-e3ed6a9b01a6 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:49:34.089610 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-59f1094b-94e1-4efa-a3a1-e3ed6a9b01a6 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:34.090266 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-59f1094b-94e1-4efa-a3a1-e3ed6a9b01a6 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:34.091478 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-59f1094b-94e1-4efa-a3a1-e3ed6a9b01a6 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:34.092125 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-59f1094b-94e1-4efa-a3a1-e3ed6a9b01a6 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:34.239031 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-59f1094b-94e1-4efa-a3a1-e3ed6a9b01a6 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:34.247683 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-59f1094b-94e1-4efa-a3a1-e3ed6a9b01a6 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:34.250250 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-59f1094b-94e1-4efa-a3a1-e3ed6a9b01a6 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:34.250951 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-59f1094b-94e1-4efa-a3a1-e3ed6a9b01a6 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1736 microversion: 2.20 time: 0.173247 Jun 23 11:49:34.262359 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 310/583] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:49:34 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1736 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:49:35.271641 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-b5819c10-64ff-4785-acbc-bcdf00b1a8ac tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:49:35.273274 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-b5819c10-64ff-4785-acbc-bcdf00b1a8ac tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:49:35.281758 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-b5819c10-64ff-4785-acbc-bcdf00b1a8ac tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:35.282251 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-b5819c10-64ff-4785-acbc-bcdf00b1a8ac tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:35.282742 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-9e41cafa-f1ef-43a5-b42a-3764b0db31ae tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:49:35.283202 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-b5819c10-64ff-4785-acbc-bcdf00b1a8ac tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:35.283757 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-b5819c10-64ff-4785-acbc-bcdf00b1a8ac tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:35.283903 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-9e41cafa-f1ef-43a5-b42a-3764b0db31ae tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] [instance: a1d17def-3652-4ad4-9b36-88a1982bf70f] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:49:35.292100 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-9e41cafa-f1ef-43a5-b42a-3764b0db31ae tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:35.292555 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-9e41cafa-f1ef-43a5-b42a-3764b0db31ae tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:35.293507 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-9e41cafa-f1ef-43a5-b42a-3764b0db31ae tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:35.293910 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-9e41cafa-f1ef-43a5-b42a-3764b0db31ae tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:35.329152 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-9e41cafa-f1ef-43a5-b42a-3764b0db31ae tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] [instance: a1d17def-3652-4ad4-9b36-88a1982bf70f] Going to try to terminate instance {{(pid=124670) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 11:49:35.429262 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-b5819c10-64ff-4785-acbc-bcdf00b1a8ac tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:35.437992 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-b5819c10-64ff-4785-acbc-bcdf00b1a8ac tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:35.439553 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-b5819c10-64ff-4785-acbc-bcdf00b1a8ac tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:35.440712 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-b5819c10-64ff-4785-acbc-bcdf00b1a8ac tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1736 microversion: 2.20 time: 0.174374 Jun 23 11:49:35.441508 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 274/584] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:49:35 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1736 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:49:35.662597 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-9e41cafa-f1ef-43a5-b42a-3764b0db31ae tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a1d17def-3652-4ad4-9b36-88a1982bf70f" status: 204 len: 0 microversion: 2.1 time: 0.390156 Jun 23 11:49:35.666994 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 311/585] 10.222.0.13 () {58 vars in 1238 bytes} [Thu Jun 23 11:49:35 2022] DELETE /compute/v2.1/servers/a1d17def-3652-4ad4-9b36-88a1982bf70f => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 11:49:35.671998 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-9253aeb3-2c65-4b86-b669-401214e0cda8 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:49:35.672671 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-9253aeb3-2c65-4b86-b669-401214e0cda8 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] [instance: a1d17def-3652-4ad4-9b36-88a1982bf70f] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:49:35.679275 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-9253aeb3-2c65-4b86-b669-401214e0cda8 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:35.679748 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-9253aeb3-2c65-4b86-b669-401214e0cda8 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:35.680529 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-9253aeb3-2c65-4b86-b669-401214e0cda8 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:35.680959 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-9253aeb3-2c65-4b86-b669-401214e0cda8 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:35.823953 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-9253aeb3-2c65-4b86-b669-401214e0cda8 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0cc563017646f6acea9127f7f525ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2187f9489844ab8bbf1f69df83b2de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:35.833504 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-9253aeb3-2c65-4b86-b669-401214e0cda8 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] 10.222.0.13 "GET /compute/v2.1/servers/a1d17def-3652-4ad4-9b36-88a1982bf70f" status: 200 len: 1514 microversion: 2.1 time: 0.165373 Jun 23 11:49:35.834095 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 275/586] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:49:35 2022] GET /compute/v2.1/servers/a1d17def-3652-4ad4-9b36-88a1982bf70f => generated 1514 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:49:36.508906 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-20e3f524-2582-46ca-b3bf-43f405cb7bc3 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:49:36.509608 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-20e3f524-2582-46ca-b3bf-43f405cb7bc3 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:49:36.515734 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-20e3f524-2582-46ca-b3bf-43f405cb7bc3 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:36.516185 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-20e3f524-2582-46ca-b3bf-43f405cb7bc3 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:36.516951 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-20e3f524-2582-46ca-b3bf-43f405cb7bc3 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:36.517389 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-20e3f524-2582-46ca-b3bf-43f405cb7bc3 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:36.670008 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-20e3f524-2582-46ca-b3bf-43f405cb7bc3 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:36.677948 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-20e3f524-2582-46ca-b3bf-43f405cb7bc3 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:36.679468 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-20e3f524-2582-46ca-b3bf-43f405cb7bc3 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:36.680674 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-20e3f524-2582-46ca-b3bf-43f405cb7bc3 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1736 microversion: 2.20 time: 0.223883 Jun 23 11:49:36.681225 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 312/587] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:49:36 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1736 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:49:36.850233 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-31f87cca-c380-4877-8635-8d7c39ff0ed9 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:49:36.851378 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-31f87cca-c380-4877-8635-8d7c39ff0ed9 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] [instance: a1d17def-3652-4ad4-9b36-88a1982bf70f] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:49:36.857706 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-31f87cca-c380-4877-8635-8d7c39ff0ed9 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:36.858163 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-31f87cca-c380-4877-8635-8d7c39ff0ed9 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:36.859082 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-31f87cca-c380-4877-8635-8d7c39ff0ed9 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:36.859524 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-31f87cca-c380-4877-8635-8d7c39ff0ed9 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:37.003315 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-31f87cca-c380-4877-8635-8d7c39ff0ed9 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0cc563017646f6acea9127f7f525ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2187f9489844ab8bbf1f69df83b2de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:37.012080 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-31f87cca-c380-4877-8635-8d7c39ff0ed9 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] 10.222.0.13 "GET /compute/v2.1/servers/a1d17def-3652-4ad4-9b36-88a1982bf70f" status: 200 len: 1514 microversion: 2.1 time: 0.165686 Jun 23 11:49:37.022965 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 276/588] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:49:36 2022] GET /compute/v2.1/servers/a1d17def-3652-4ad4-9b36-88a1982bf70f => generated 1514 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:49:37.701102 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-ebad5fcd-dd3f-4497-b56e-f7fb1fce114c tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:49:37.702354 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-ebad5fcd-dd3f-4497-b56e-f7fb1fce114c tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:49:37.718202 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-ebad5fcd-dd3f-4497-b56e-f7fb1fce114c tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:37.718689 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-ebad5fcd-dd3f-4497-b56e-f7fb1fce114c tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:37.719595 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-ebad5fcd-dd3f-4497-b56e-f7fb1fce114c tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:37.720038 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-ebad5fcd-dd3f-4497-b56e-f7fb1fce114c tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:37.963021 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-ebad5fcd-dd3f-4497-b56e-f7fb1fce114c tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:37.980239 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-ebad5fcd-dd3f-4497-b56e-f7fb1fce114c tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:37.981753 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-ebad5fcd-dd3f-4497-b56e-f7fb1fce114c tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:37.983010 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-ebad5fcd-dd3f-4497-b56e-f7fb1fce114c tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1736 microversion: 2.20 time: 0.286472 Jun 23 11:49:37.995644 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 313/589] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:49:37 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1736 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:49:38.029973 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-2112afa2-522c-479f-b088-348850cc3577 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:49:38.030686 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-2112afa2-522c-479f-b088-348850cc3577 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] [instance: a1d17def-3652-4ad4-9b36-88a1982bf70f] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:49:38.041814 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-2112afa2-522c-479f-b088-348850cc3577 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:38.047873 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-2112afa2-522c-479f-b088-348850cc3577 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:38.047873 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-2112afa2-522c-479f-b088-348850cc3577 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:38.047873 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-2112afa2-522c-479f-b088-348850cc3577 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:38.247686 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-2112afa2-522c-479f-b088-348850cc3577 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0cc563017646f6acea9127f7f525ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2187f9489844ab8bbf1f69df83b2de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:38.260731 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-2112afa2-522c-479f-b088-348850cc3577 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] 10.222.0.13 "GET /compute/v2.1/servers/a1d17def-3652-4ad4-9b36-88a1982bf70f" status: 200 len: 1514 microversion: 2.1 time: 0.234854 Jun 23 11:49:38.272216 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 277/590] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:49:38 2022] GET /compute/v2.1/servers/a1d17def-3652-4ad4-9b36-88a1982bf70f => generated 1514 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:49:38.521260 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [req-0ff9763c-816f-447a-bdb4-0b4b4c365bc6 req-eb6227d2-bbee-4061-b17c-007ea3639c2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1d17def-3652-4ad4-9b36-88a1982bf70f", "name": "network-vif-deleted", "tag": "6396080a-5287-4fc0-976c-3d39892fc767"}]} {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:49:38.530191 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-0ff9763c-816f-447a-bdb4-0b4b4c365bc6 req-eb6227d2-bbee-4061-b17c-007ea3639c2c service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:38.530651 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-0ff9763c-816f-447a-bdb4-0b4b4c365bc6 req-eb6227d2-bbee-4061-b17c-007ea3639c2c service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:38.544742 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.compute.server_external_events [req-0ff9763c-816f-447a-bdb4-0b4b4c365bc6 req-eb6227d2-bbee-4061-b17c-007ea3639c2c service nova] Creating event network-vif-deleted:6396080a-5287-4fc0-976c-3d39892fc767 for instance a1d17def-3652-4ad4-9b36-88a1982bf70f on hv-cinder-82099 Jun 23 11:49:38.550062 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [req-0ff9763c-816f-447a-bdb4-0b4b4c365bc6 req-eb6227d2-bbee-4061-b17c-007ea3639c2c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032969 Jun 23 11:49:38.551389 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 314/591] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:49:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:49:39.002665 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-226bdf70-a151-4d46-9464-8b8949366b80 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:49:39.003492 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-226bdf70-a151-4d46-9464-8b8949366b80 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:49:39.010582 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-226bdf70-a151-4d46-9464-8b8949366b80 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:39.011170 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-226bdf70-a151-4d46-9464-8b8949366b80 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:39.012074 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-226bdf70-a151-4d46-9464-8b8949366b80 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:39.012732 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-226bdf70-a151-4d46-9464-8b8949366b80 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:39.173524 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-226bdf70-a151-4d46-9464-8b8949366b80 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:39.181803 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-226bdf70-a151-4d46-9464-8b8949366b80 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:39.183562 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-226bdf70-a151-4d46-9464-8b8949366b80 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:39.184948 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-226bdf70-a151-4d46-9464-8b8949366b80 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1736 microversion: 2.20 time: 0.186938 Jun 23 11:49:39.185684 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 278/592] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:49:38 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1736 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:49:39.280302 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-7c046de3-389b-4d48-8d12-6dd624b92389 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:49:39.281635 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-7c046de3-389b-4d48-8d12-6dd624b92389 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] [instance: a1d17def-3652-4ad4-9b36-88a1982bf70f] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:49:39.291385 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-7c046de3-389b-4d48-8d12-6dd624b92389 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:39.291840 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-7c046de3-389b-4d48-8d12-6dd624b92389 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:39.292622 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-7c046de3-389b-4d48-8d12-6dd624b92389 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:39.293059 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-7c046de3-389b-4d48-8d12-6dd624b92389 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:39.339286 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-7c046de3-389b-4d48-8d12-6dd624b92389 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:39.339991 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-7c046de3-389b-4d48-8d12-6dd624b92389 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:39.340670 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.objects.instance [None req-7c046de3-389b-4d48-8d12-6dd624b92389 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lazy-loading 'fault' on Instance uuid a1d17def-3652-4ad4-9b36-88a1982bf70f {{(pid=124670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:49:39.390920 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-7c046de3-389b-4d48-8d12-6dd624b92389 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0cc563017646f6acea9127f7f525ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb2187f9489844ab8bbf1f69df83b2de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:39.398481 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-7c046de3-389b-4d48-8d12-6dd624b92389 tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] 10.222.0.13 "GET /compute/v2.1/servers/a1d17def-3652-4ad4-9b36-88a1982bf70f" status: 200 len: 1309 microversion: 2.1 time: 0.122616 Jun 23 11:49:39.399090 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 315/593] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:49:39 2022] GET /compute/v2.1/servers/a1d17def-3652-4ad4-9b36-88a1982bf70f => generated 1309 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:49:40.206168 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-8053e063-4aaa-4309-a497-7dc6d15955cf tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:49:40.208530 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-8053e063-4aaa-4309-a497-7dc6d15955cf tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:49:40.215265 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-8053e063-4aaa-4309-a497-7dc6d15955cf tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:40.216183 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-8053e063-4aaa-4309-a497-7dc6d15955cf tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:40.217152 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-8053e063-4aaa-4309-a497-7dc6d15955cf tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:40.217890 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-8053e063-4aaa-4309-a497-7dc6d15955cf tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:40.363890 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-8053e063-4aaa-4309-a497-7dc6d15955cf tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:40.374185 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-8053e063-4aaa-4309-a497-7dc6d15955cf tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:40.376755 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-8053e063-4aaa-4309-a497-7dc6d15955cf tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:40.377927 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-8053e063-4aaa-4309-a497-7dc6d15955cf tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1736 microversion: 2.20 time: 0.176913 Jun 23 11:49:40.395328 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 279/594] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:49:40 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1736 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:49:40.417304 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-8c187726-4214-42b1-9daa-81bf8795087c tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:49:40.417900 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-8c187726-4214-42b1-9daa-81bf8795087c tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] [instance: a1d17def-3652-4ad4-9b36-88a1982bf70f] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:49:40.424863 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-8c187726-4214-42b1-9daa-81bf8795087c tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:40.425388 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-8c187726-4214-42b1-9daa-81bf8795087c tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:40.426928 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-8c187726-4214-42b1-9daa-81bf8795087c tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:40.427574 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-8c187726-4214-42b1-9daa-81bf8795087c tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:40.442805 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.wsgi [None req-8c187726-4214-42b1-9daa-81bf8795087c tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] HTTP exception thrown: Instance a1d17def-3652-4ad4-9b36-88a1982bf70f could not be found. Jun 23 11:49:40.445133 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-8c187726-4214-42b1-9daa-81bf8795087c tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Request method failure captured: Jun 23 11:49:40.445133 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: request: GET /compute/v2.1/servers/a1d17def-3652-4ad4-9b36-88a1982bf70f HTTP/1.1 Jun 23 11:49:40.445133 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Accept: application/json Jun 23 11:49:40.445133 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Accept-Encoding: identity Jun 23 11:49:40.445133 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Connection: close Jun 23 11:49:40.445133 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Content-Length: 0 Jun 23 11:49:40.445133 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Content-Type: application/json Jun 23 11:49:40.445133 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Host: 10.222.0.13 Jun 23 11:49:40.445133 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Openstack-System-Scope: None Jun 23 11:49:40.445133 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: User-Agent: python-urllib3/1.26.9 Jun 23 11:49:40.445133 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Auth-Token: gAAAAABitFKkKJt8qFDBnXZo9xyduqnp5He-00GSqFlDcD3i4aqs9ASURPdh_Lt4Z7amtNp99QnpTD2ediDK1s7bKPMIATMXHtn7l5Y1iAeKldeCC3Rk_S6idnG0o3m2td7v7z91ejp0AIyvv8hdtprFP1aB8S2DqS8l6BedX3Y-kniGAfM1iLE Jun 23 11:49:40.445133 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Domain-Id: None Jun 23 11:49:40.445133 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Domain-Name: None Jun 23 11:49:40.445133 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Identity-Status: Confirmed Jun 23 11:49:40.445133 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Is-Admin-Project: True Jun 23 11:49:40.445133 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Domain-Id: default Jun 23 11:49:40.445133 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Domain-Name: Default Jun 23 11:49:40.445133 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Id: eb2187f9489844ab8bbf1f69df83b2de Jun 23 11:49:40.445133 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1522463724 Jun 23 11:49:40.445133 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Role: member,reader Jun 23 11:49:40.445133 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Roles: member,reader Jun 23 11:49:40.446486 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_eb2187f9489844ab8bbf1f69df83b2de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/eb2187f9489844ab8bbf1f69df83b2de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/eb2187f9489844ab8bbf1f69df83b2de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/eb2187f9489844ab8bbf1f69df83b2de"}]}] Jun 23 11:49:40.446486 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Tenant: tempest-VolumesSnapshotTestJSON-1522463724 Jun 23 11:49:40.446486 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Tenant-Id: eb2187f9489844ab8bbf1f69df83b2de Jun 23 11:49:40.446486 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1522463724 Jun 23 11:49:40.446486 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User: tempest-VolumesSnapshotTestJSON-1522463724-project Jun 23 11:49:40.446486 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Domain-Id: default Jun 23 11:49:40.446486 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Domain-Name: Default Jun 23 11:49:40.446486 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Id: 5e0cc563017646f6acea9127f7f525ee Jun 23 11:49:40.446486 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Name: tempest-VolumesSnapshotTestJSON-1522463724-project Jun 23 11:49:40.446486 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: method: > Jun 23 11:49:40.446486 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: exception: Instance a1d17def-3652-4ad4-9b36-88a1982bf70f could not be found. Jun 23 11:49:40.446486 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: action_args: {'id': 'a1d17def-3652-4ad4-9b36-88a1982bf70f'} Jun 23 11:49:40.447264 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:49:40.447264 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:49:40.447264 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:49:40.447264 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:49:40.447264 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:49:40.447264 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:49:40.447264 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:49:40.447264 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:49:40.447264 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:49:40.447264 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:49:40.447264 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1d17def-3652-4ad4-9b36-88a1982bf70f could not be found. Jun 23 11:49:40.447264 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:49:40.447264 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:49:40.447264 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:49:40.447264 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:49:40.447264 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:49:40.447264 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:49:40.447264 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:49:40.447264 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:49:40.447264 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:49:40.448498 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:49:40.448498 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 11:49:40.448498 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 11:49:40.448498 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:49:40.448498 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:49:40.448498 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:49:40.448498 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:49:40.448498 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1d17def-3652-4ad4-9b36-88a1982bf70f could not be found. Jun 23 11:49:40.448498 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:49:40.448498 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:49:40.448498 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:49:40.448498 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:49:40.448498 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:49:40.448498 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:49:40.448498 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:49:40.448498 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:49:40.448498 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1d17def-3652-4ad4-9b36-88a1982bf70f could not be found. Jun 23 11:49:40.448498 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:49:40.450864 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-8c187726-4214-42b1-9daa-81bf8795087c tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] Returning 404 to user: Instance a1d17def-3652-4ad4-9b36-88a1982bf70f could not be found. {{(pid=124670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:49:40.451860 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-8c187726-4214-42b1-9daa-81bf8795087c tempest-VolumesSnapshotTestJSON-1522463724 tempest-VolumesSnapshotTestJSON-1522463724-project] 10.222.0.13 "GET /compute/v2.1/servers/a1d17def-3652-4ad4-9b36-88a1982bf70f" status: 404 len: 111 microversion: 2.1 time: 0.039056 Jun 23 11:49:40.452711 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 316/595] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:49:40 2022] GET /compute/v2.1/servers/a1d17def-3652-4ad4-9b36-88a1982bf70f => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:49:41.401595 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-a9e8d28d-2da9-400a-9b0f-89b35b9fade8 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:49:41.402206 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-a9e8d28d-2da9-400a-9b0f-89b35b9fade8 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:49:41.404748 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_api:SELECT=34 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:49:41.409618 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-a9e8d28d-2da9-400a-9b0f-89b35b9fade8 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:41.410071 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-a9e8d28d-2da9-400a-9b0f-89b35b9fade8 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:41.411342 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-a9e8d28d-2da9-400a-9b0f-89b35b9fade8 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:41.411776 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-a9e8d28d-2da9-400a-9b0f-89b35b9fade8 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:41.542354 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-a9e8d28d-2da9-400a-9b0f-89b35b9fade8 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:41.550141 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-a9e8d28d-2da9-400a-9b0f-89b35b9fade8 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:41.552448 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-a9e8d28d-2da9-400a-9b0f-89b35b9fade8 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:41.553600 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-a9e8d28d-2da9-400a-9b0f-89b35b9fade8 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1736 microversion: 2.20 time: 0.155954 Jun 23 11:49:41.554152 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 280/596] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:49:41 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:49:42.572238 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-3d96cd4d-1dd2-4698-bded-37532fcb7847 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:49:42.572847 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-3d96cd4d-1dd2-4698-bded-37532fcb7847 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:49:42.574896 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:49:42.579633 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-3d96cd4d-1dd2-4698-bded-37532fcb7847 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:42.580082 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-3d96cd4d-1dd2-4698-bded-37532fcb7847 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:42.580834 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-3d96cd4d-1dd2-4698-bded-37532fcb7847 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:42.581267 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-3d96cd4d-1dd2-4698-bded-37532fcb7847 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:42.784601 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-3d96cd4d-1dd2-4698-bded-37532fcb7847 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:42.793107 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-3d96cd4d-1dd2-4698-bded-37532fcb7847 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:42.794623 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-3d96cd4d-1dd2-4698-bded-37532fcb7847 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:42.795771 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-3d96cd4d-1dd2-4698-bded-37532fcb7847 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1718 microversion: 2.20 time: 0.227633 Jun 23 11:49:42.796319 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 317/597] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:49:42 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1718 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:49:43.814028 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-87d5754a-a8fa-4482-b204-2db28b677017 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:49:43.814599 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-87d5754a-a8fa-4482-b204-2db28b677017 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:49:43.822020 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-87d5754a-a8fa-4482-b204-2db28b677017 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:43.822525 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-87d5754a-a8fa-4482-b204-2db28b677017 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:43.823288 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-87d5754a-a8fa-4482-b204-2db28b677017 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:43.823723 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-87d5754a-a8fa-4482-b204-2db28b677017 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:43.951829 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-87d5754a-a8fa-4482-b204-2db28b677017 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:43.960638 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-87d5754a-a8fa-4482-b204-2db28b677017 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:43.962204 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-87d5754a-a8fa-4482-b204-2db28b677017 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:43.963391 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-87d5754a-a8fa-4482-b204-2db28b677017 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1718 microversion: 2.20 time: 0.153367 Jun 23 11:49:43.963943 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 281/598] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:49:43 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1718 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:49:44.982005 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-4f001d47-b55a-4c90-9482-3a744b0b3f6f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:49:44.982637 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-4f001d47-b55a-4c90-9482-3a744b0b3f6f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:49:44.988857 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-4f001d47-b55a-4c90-9482-3a744b0b3f6f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:44.989310 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-4f001d47-b55a-4c90-9482-3a744b0b3f6f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:44.990058 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-4f001d47-b55a-4c90-9482-3a744b0b3f6f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:44.990489 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-4f001d47-b55a-4c90-9482-3a744b0b3f6f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:45.116139 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-4f001d47-b55a-4c90-9482-3a744b0b3f6f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:45.123971 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-4f001d47-b55a-4c90-9482-3a744b0b3f6f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:45.125505 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-4f001d47-b55a-4c90-9482-3a744b0b3f6f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:45.126707 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-4f001d47-b55a-4c90-9482-3a744b0b3f6f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1718 microversion: 2.20 time: 0.148587 Jun 23 11:49:45.127254 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 318/599] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:49:44 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1718 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:49:46.146227 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-c60169a8-52cb-4209-bbbc-f705367ef1c4 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:49:46.146868 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-c60169a8-52cb-4209-bbbc-f705367ef1c4 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:49:46.153813 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c60169a8-52cb-4209-bbbc-f705367ef1c4 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:46.154257 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c60169a8-52cb-4209-bbbc-f705367ef1c4 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:46.155137 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c60169a8-52cb-4209-bbbc-f705367ef1c4 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:46.155578 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c60169a8-52cb-4209-bbbc-f705367ef1c4 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:46.175887 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:49:46.302864 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-c60169a8-52cb-4209-bbbc-f705367ef1c4 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:46.310668 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-c60169a8-52cb-4209-bbbc-f705367ef1c4 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:46.312167 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-c60169a8-52cb-4209-bbbc-f705367ef1c4 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:46.313316 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-c60169a8-52cb-4209-bbbc-f705367ef1c4 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1718 microversion: 2.20 time: 0.172213 Jun 23 11:49:46.313870 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 282/600] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:49:46 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1718 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:49:46.547203 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [req-7bd841e9-8dc3-4725-a55c-0563570b4ad5 req-4b15050f-c91a-49df-9cc2-6a903451e95e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9e98590-5036-4ade-bbba-f743256ac961", "name": "network-vif-unplugged", "status": "completed", "tag": "ff54d5bf-cdc7-493b-be07-f5ca28b2681b"}]} {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:49:46.556688 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-7bd841e9-8dc3-4725-a55c-0563570b4ad5 req-4b15050f-c91a-49df-9cc2-6a903451e95e service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:46.557113 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-7bd841e9-8dc3-4725-a55c-0563570b4ad5 req-4b15050f-c91a-49df-9cc2-6a903451e95e service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:46.568208 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.compute.server_external_events [req-7bd841e9-8dc3-4725-a55c-0563570b4ad5 req-4b15050f-c91a-49df-9cc2-6a903451e95e service nova] Creating event network-vif-unplugged:ff54d5bf-cdc7-493b-be07-f5ca28b2681b for instance d9e98590-5036-4ade-bbba-f743256ac961 on hv-cinder-82099 Jun 23 11:49:46.573416 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [req-7bd841e9-8dc3-4725-a55c-0563570b4ad5 req-4b15050f-c91a-49df-9cc2-6a903451e95e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029742 Jun 23 11:49:46.574005 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 319/601] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:49:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:49:47.331996 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-808cce94-de8f-48f2-8536-685868d11bf3 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:49:47.332607 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-808cce94-de8f-48f2-8536-685868d11bf3 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:49:47.339754 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-808cce94-de8f-48f2-8536-685868d11bf3 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:47.340203 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-808cce94-de8f-48f2-8536-685868d11bf3 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:47.340956 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-808cce94-de8f-48f2-8536-685868d11bf3 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:47.341397 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-808cce94-de8f-48f2-8536-685868d11bf3 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:47.470519 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-808cce94-de8f-48f2-8536-685868d11bf3 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:47.479301 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-808cce94-de8f-48f2-8536-685868d11bf3 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:47.480805 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-808cce94-de8f-48f2-8536-685868d11bf3 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:47.481988 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-808cce94-de8f-48f2-8536-685868d11bf3 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1718 microversion: 2.20 time: 0.153919 Jun 23 11:49:47.482565 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 283/602] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:49:47 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1718 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:49:48.500510 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-be7958b6-02b4-4c6d-ad2c-5b0cf7926bac tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:49:48.505645 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-be7958b6-02b4-4c6d-ad2c-5b0cf7926bac tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:49:48.508249 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-be7958b6-02b4-4c6d-ad2c-5b0cf7926bac tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:48.508689 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-be7958b6-02b4-4c6d-ad2c-5b0cf7926bac tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:48.509437 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-be7958b6-02b4-4c6d-ad2c-5b0cf7926bac tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:48.509864 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-be7958b6-02b4-4c6d-ad2c-5b0cf7926bac tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:48.650713 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-be7958b6-02b4-4c6d-ad2c-5b0cf7926bac tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:48.659274 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-be7958b6-02b4-4c6d-ad2c-5b0cf7926bac tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:48.661751 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-be7958b6-02b4-4c6d-ad2c-5b0cf7926bac tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:48.663002 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-be7958b6-02b4-4c6d-ad2c-5b0cf7926bac tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1718 microversion: 2.20 time: 0.166710 Jun 23 11:49:48.663851 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 320/603] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:49:48 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1718 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:49:48.920248 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-be1d8968-cecd-4667-80f4-d25c00bf3b34 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ff87e09b-2262-45d8-aade-6673642c4a09"}} {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:49:48.921496 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-be1d8968-cecd-4667-80f4-d25c00bf3b34 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 6b648e87-b71a-4ef3-aada-f884b8efb154] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:49:48.930120 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-be1d8968-cecd-4667-80f4-d25c00bf3b34 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:48.931107 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-be1d8968-cecd-4667-80f4-d25c00bf3b34 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:48.931937 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-be1d8968-cecd-4667-80f4-d25c00bf3b34 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:48.932382 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-be1d8968-cecd-4667-80f4-d25c00bf3b34 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:49.674313 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-be1d8968-cecd-4667-80f4-d25c00bf3b34 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "POST /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.865170 Jun 23 11:49:49.675775 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 284/604] 10.222.0.13 () {60 vars in 1322 bytes} [Thu Jun 23 11:49:48 2022] POST /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154/os-volume_attachments => generated 194 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:49:49.681078 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-bf83ca68-acd0-452c-ba09-50b0bd0086b4 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:49:49.681676 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-bf83ca68-acd0-452c-ba09-50b0bd0086b4 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:49:49.688515 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-bf83ca68-acd0-452c-ba09-50b0bd0086b4 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:49.689081 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-bf83ca68-acd0-452c-ba09-50b0bd0086b4 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:49.689699 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-bf83ca68-acd0-452c-ba09-50b0bd0086b4 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:49.690130 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-bf83ca68-acd0-452c-ba09-50b0bd0086b4 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:49.818394 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-bf83ca68-acd0-452c-ba09-50b0bd0086b4 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:49.826621 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-bf83ca68-acd0-452c-ba09-50b0bd0086b4 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:49.828106 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-bf83ca68-acd0-452c-ba09-50b0bd0086b4 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:49.829380 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-bf83ca68-acd0-452c-ba09-50b0bd0086b4 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1661 microversion: 2.20 time: 0.152009 Jun 23 11:49:49.830010 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 321/605] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:49:49 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1661 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:49:49.849219 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-247fe662-3a62-459d-a732-84474ba4d78d tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "221b37a4-e7a5-4dc4-903a-9832df2eaade"}} {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:49:49.850375 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-247fe662-3a62-459d-a732-84474ba4d78d tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:49:49.856626 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-247fe662-3a62-459d-a732-84474ba4d78d tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:49.859818 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-247fe662-3a62-459d-a732-84474ba4d78d tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:49.859818 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-247fe662-3a62-459d-a732-84474ba4d78d tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:49.859818 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-247fe662-3a62-459d-a732-84474ba4d78d tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:51.019126 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-247fe662-3a62-459d-a732-84474ba4d78d tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "POST /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.174904 Jun 23 11:49:51.019770 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 285/606] 10.222.0.13 () {62 vars in 1363 bytes} [Thu Jun 23 11:49:49 2022] POST /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961/os-volume_attachments => generated 188 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 11:49:51.134615 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-1ba3c482-fbd4-4406-93a1-1571f2ba5375 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:49:51.135286 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-1ba3c482-fbd4-4406-93a1-1571f2ba5375 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:49:51.141219 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1ba3c482-fbd4-4406-93a1-1571f2ba5375 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:51.141666 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1ba3c482-fbd4-4406-93a1-1571f2ba5375 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:51.142442 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1ba3c482-fbd4-4406-93a1-1571f2ba5375 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:51.142906 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1ba3c482-fbd4-4406-93a1-1571f2ba5375 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:51.311961 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:49:51.367043 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-1ba3c482-fbd4-4406-93a1-1571f2ba5375 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "POST /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961/action" status: 202 len: 0 microversion: 2.20 time: 0.236563 Jun 23 11:49:51.367919 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 322/607] 10.222.0.13 () {62 vars in 1318 bytes} [Thu Jun 23 11:49:51 2022] POST /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 23 11:49:51.376018 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-29fd0c65-2d8c-4a12-93b1-37770588446e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:49:51.376611 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-29fd0c65-2d8c-4a12-93b1-37770588446e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:49:51.384219 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-29fd0c65-2d8c-4a12-93b1-37770588446e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:51.387161 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-29fd0c65-2d8c-4a12-93b1-37770588446e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:51.387161 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-29fd0c65-2d8c-4a12-93b1-37770588446e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:51.387161 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-29fd0c65-2d8c-4a12-93b1-37770588446e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:51.523269 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-29fd0c65-2d8c-4a12-93b1-37770588446e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:51.532390 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-29fd0c65-2d8c-4a12-93b1-37770588446e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:51.533936 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-29fd0c65-2d8c-4a12-93b1-37770588446e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:51.535137 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-29fd0c65-2d8c-4a12-93b1-37770588446e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1747 microversion: 2.20 time: 0.163201 Jun 23 11:49:51.535694 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 286/608] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:49:51 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1747 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:49:52.553812 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-e67cd34d-e755-4f91-bd9c-700fdda76e2f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:49:52.554640 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-e67cd34d-e755-4f91-bd9c-700fdda76e2f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:49:52.561520 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-e67cd34d-e755-4f91-bd9c-700fdda76e2f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:52.561964 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-e67cd34d-e755-4f91-bd9c-700fdda76e2f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:52.562749 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-e67cd34d-e755-4f91-bd9c-700fdda76e2f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:52.563180 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-e67cd34d-e755-4f91-bd9c-700fdda76e2f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:52.699072 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-e67cd34d-e755-4f91-bd9c-700fdda76e2f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:52.707911 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-e67cd34d-e755-4f91-bd9c-700fdda76e2f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:52.710159 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-e67cd34d-e755-4f91-bd9c-700fdda76e2f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:52.711439 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-e67cd34d-e755-4f91-bd9c-700fdda76e2f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1747 microversion: 2.20 time: 0.161950 Jun 23 11:49:52.711991 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 323/609] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:49:52 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1747 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:49:53.730883 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-c49c4908-4970-4e22-99f6-0d8719e1e955 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:49:53.731488 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-c49c4908-4970-4e22-99f6-0d8719e1e955 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:49:53.738376 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c49c4908-4970-4e22-99f6-0d8719e1e955 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:53.738614 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c49c4908-4970-4e22-99f6-0d8719e1e955 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:53.739373 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c49c4908-4970-4e22-99f6-0d8719e1e955 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:53.739804 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c49c4908-4970-4e22-99f6-0d8719e1e955 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:53.870221 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-c49c4908-4970-4e22-99f6-0d8719e1e955 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:53.878491 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-c49c4908-4970-4e22-99f6-0d8719e1e955 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:53.879995 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-c49c4908-4970-4e22-99f6-0d8719e1e955 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:53.881148 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-c49c4908-4970-4e22-99f6-0d8719e1e955 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1749 microversion: 2.20 time: 0.154305 Jun 23 11:49:53.882210 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 287/610] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:49:53 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1749 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:49:54.903682 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-57b1fdad-59dc-4764-b273-b4c9a0a33cbb tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:49:54.904280 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-57b1fdad-59dc-4764-b273-b4c9a0a33cbb tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:49:54.910190 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-57b1fdad-59dc-4764-b273-b4c9a0a33cbb tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:54.910667 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-57b1fdad-59dc-4764-b273-b4c9a0a33cbb tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:54.911420 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-57b1fdad-59dc-4764-b273-b4c9a0a33cbb tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:54.911847 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-57b1fdad-59dc-4764-b273-b4c9a0a33cbb tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:55.040730 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-57b1fdad-59dc-4764-b273-b4c9a0a33cbb tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:55.048987 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-57b1fdad-59dc-4764-b273-b4c9a0a33cbb tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:55.050480 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-57b1fdad-59dc-4764-b273-b4c9a0a33cbb tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:55.051650 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-57b1fdad-59dc-4764-b273-b4c9a0a33cbb tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1749 microversion: 2.20 time: 0.151872 Jun 23 11:49:55.058686 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 324/611] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:49:54 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1749 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:49:56.069946 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-93d6c3fc-586b-4db4-aa21-7f65fd44e75e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:49:56.070621 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-93d6c3fc-586b-4db4-aa21-7f65fd44e75e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:49:56.077150 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-93d6c3fc-586b-4db4-aa21-7f65fd44e75e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:56.077601 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-93d6c3fc-586b-4db4-aa21-7f65fd44e75e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:56.078356 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-93d6c3fc-586b-4db4-aa21-7f65fd44e75e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:56.078839 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-93d6c3fc-586b-4db4-aa21-7f65fd44e75e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:56.208945 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-93d6c3fc-586b-4db4-aa21-7f65fd44e75e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:56.217757 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-93d6c3fc-586b-4db4-aa21-7f65fd44e75e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:56.219279 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-93d6c3fc-586b-4db4-aa21-7f65fd44e75e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:56.220456 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-93d6c3fc-586b-4db4-aa21-7f65fd44e75e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1749 microversion: 2.20 time: 0.154489 Jun 23 11:49:56.221004 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 288/612] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:49:56 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1749 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:49:57.238166 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-1f63415e-d6e7-4441-a51f-9a7c0115c8fc tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:49:57.238798 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-1f63415e-d6e7-4441-a51f-9a7c0115c8fc tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:49:57.244980 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1f63415e-d6e7-4441-a51f-9a7c0115c8fc tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:57.245438 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1f63415e-d6e7-4441-a51f-9a7c0115c8fc tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:57.246196 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1f63415e-d6e7-4441-a51f-9a7c0115c8fc tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:57.246659 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1f63415e-d6e7-4441-a51f-9a7c0115c8fc tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:57.375473 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-1f63415e-d6e7-4441-a51f-9a7c0115c8fc tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:57.384360 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-1f63415e-d6e7-4441-a51f-9a7c0115c8fc tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:57.385859 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-1f63415e-d6e7-4441-a51f-9a7c0115c8fc tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:57.387037 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-1f63415e-d6e7-4441-a51f-9a7c0115c8fc tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1749 microversion: 2.20 time: 0.152730 Jun 23 11:49:57.387591 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 325/613] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:49:57 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1749 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:49:58.405152 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-7cf1a0b6-2e19-47ea-b2bf-e699c6efe183 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:49:58.405777 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-7cf1a0b6-2e19-47ea-b2bf-e699c6efe183 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:49:58.412190 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-7cf1a0b6-2e19-47ea-b2bf-e699c6efe183 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:58.412646 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-7cf1a0b6-2e19-47ea-b2bf-e699c6efe183 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:58.413372 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-7cf1a0b6-2e19-47ea-b2bf-e699c6efe183 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:58.414454 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-7cf1a0b6-2e19-47ea-b2bf-e699c6efe183 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:58.541214 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-7cf1a0b6-2e19-47ea-b2bf-e699c6efe183 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:58.549516 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-7cf1a0b6-2e19-47ea-b2bf-e699c6efe183 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:58.551030 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-7cf1a0b6-2e19-47ea-b2bf-e699c6efe183 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:58.552184 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-7cf1a0b6-2e19-47ea-b2bf-e699c6efe183 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1749 microversion: 2.20 time: 0.150972 Jun 23 11:49:58.552727 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 289/614] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:49:58 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1749 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:49:59.570638 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-64e00323-5f0b-4f93-a330-1cb1e188deea tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:49:59.571253 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-64e00323-5f0b-4f93-a330-1cb1e188deea tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:49:59.577263 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-64e00323-5f0b-4f93-a330-1cb1e188deea tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:59.577706 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-64e00323-5f0b-4f93-a330-1cb1e188deea tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:59.578452 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-64e00323-5f0b-4f93-a330-1cb1e188deea tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:49:59.578962 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-64e00323-5f0b-4f93-a330-1cb1e188deea tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:49:59.709094 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-64e00323-5f0b-4f93-a330-1cb1e188deea tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:59.718167 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-64e00323-5f0b-4f93-a330-1cb1e188deea tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:59.719682 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-64e00323-5f0b-4f93-a330-1cb1e188deea tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:49:59.720823 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-64e00323-5f0b-4f93-a330-1cb1e188deea tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1749 microversion: 2.20 time: 0.154184 Jun 23 11:49:59.721370 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 326/615] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:49:59 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1749 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:50:00.739252 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-31c58fac-e6b3-4558-9fc9-1abbc50f3ddd tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:00.739871 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-31c58fac-e6b3-4558-9fc9-1abbc50f3ddd tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:00.747021 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-31c58fac-e6b3-4558-9fc9-1abbc50f3ddd tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:00.747476 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-31c58fac-e6b3-4558-9fc9-1abbc50f3ddd tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:00.748238 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-31c58fac-e6b3-4558-9fc9-1abbc50f3ddd tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:00.748675 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-31c58fac-e6b3-4558-9fc9-1abbc50f3ddd tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:00.874549 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-31c58fac-e6b3-4558-9fc9-1abbc50f3ddd tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:00.882857 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-31c58fac-e6b3-4558-9fc9-1abbc50f3ddd tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:00.884523 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-31c58fac-e6b3-4558-9fc9-1abbc50f3ddd tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:00.885673 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-31c58fac-e6b3-4558-9fc9-1abbc50f3ddd tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1749 microversion: 2.20 time: 0.150357 Jun 23 11:50:00.886261 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 290/616] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:50:00 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1749 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:50:01.655532 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-61f144e7-0354-4e4d-82a2-f8fa2e2a35d4 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:50:01.656475 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-61f144e7-0354-4e4d-82a2-f8fa2e2a35d4 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 6b648e87-b71a-4ef3-aada-f884b8efb154] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:01.663110 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-61f144e7-0354-4e4d-82a2-f8fa2e2a35d4 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:01.663353 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-61f144e7-0354-4e4d-82a2-f8fa2e2a35d4 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:01.664487 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-61f144e7-0354-4e4d-82a2-f8fa2e2a35d4 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:01.664629 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-61f144e7-0354-4e4d-82a2-f8fa2e2a35d4 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:01.700094 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.objects.instance [None req-61f144e7-0354-4e4d-82a2-f8fa2e2a35d4 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lazy-loading 'flavor' on Instance uuid 6b648e87-b71a-4ef3-aada-f884b8efb154 {{(pid=124670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:50:01.904369 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-afb02bf3-981b-4ed0-baab-768b9441e440 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:01.904888 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-afb02bf3-981b-4ed0-baab-768b9441e440 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:01.911552 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-afb02bf3-981b-4ed0-baab-768b9441e440 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:01.912004 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-afb02bf3-981b-4ed0-baab-768b9441e440 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:01.912769 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-afb02bf3-981b-4ed0-baab-768b9441e440 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:01.913211 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-afb02bf3-981b-4ed0-baab-768b9441e440 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:02.043299 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-afb02bf3-981b-4ed0-baab-768b9441e440 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:02.051740 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-afb02bf3-981b-4ed0-baab-768b9441e440 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:02.053232 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-afb02bf3-981b-4ed0-baab-768b9441e440 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:02.054418 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-afb02bf3-981b-4ed0-baab-768b9441e440 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1749 microversion: 2.20 time: 0.153973 Jun 23 11:50:02.055113 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 291/617] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:50:01 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1749 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:50:02.075191 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-61f144e7-0354-4e4d-82a2-f8fa2e2a35d4 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "POST /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154/action" status: 200 len: 32 microversion: 2.1 time: 0.424535 Jun 23 11:50:02.076023 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 327/618] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Jun 23 11:50:01 2022] POST /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154/action => generated 32 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 11:50:02.090404 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-c7703ff8-c25b-4aa7-aa8c-61284f0bc99e tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:02.091107 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-c7703ff8-c25b-4aa7-aa8c-61284f0bc99e tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 6b648e87-b71a-4ef3-aada-f884b8efb154] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:02.097377 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c7703ff8-c25b-4aa7-aa8c-61284f0bc99e tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:02.097836 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c7703ff8-c25b-4aa7-aa8c-61284f0bc99e tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:02.098658 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c7703ff8-c25b-4aa7-aa8c-61284f0bc99e tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:02.099103 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c7703ff8-c25b-4aa7-aa8c-61284f0bc99e tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:02.280582 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-c7703ff8-c25b-4aa7-aa8c-61284f0bc99e tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:02.289293 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-c7703ff8-c25b-4aa7-aa8c-61284f0bc99e tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154" status: 200 len: 1734 microversion: 2.1 time: 0.202988 Jun 23 11:50:02.307669 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 292/619] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:50:02 2022] GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154 => generated 1734 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:50:03.073423 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-173d68f7-b9c3-4b09-b2e4-33cdd17674ff tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:03.074113 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-173d68f7-b9c3-4b09-b2e4-33cdd17674ff tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:03.080379 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-173d68f7-b9c3-4b09-b2e4-33cdd17674ff tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:03.080818 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-173d68f7-b9c3-4b09-b2e4-33cdd17674ff tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:03.081674 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-173d68f7-b9c3-4b09-b2e4-33cdd17674ff tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:03.082042 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-173d68f7-b9c3-4b09-b2e4-33cdd17674ff tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:03.215728 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-173d68f7-b9c3-4b09-b2e4-33cdd17674ff tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:03.224560 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-173d68f7-b9c3-4b09-b2e4-33cdd17674ff tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:03.227973 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-173d68f7-b9c3-4b09-b2e4-33cdd17674ff tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:03.227973 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-173d68f7-b9c3-4b09-b2e4-33cdd17674ff tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1805 microversion: 2.20 time: 0.158630 Jun 23 11:50:03.227973 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 328/620] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:50:03 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1805 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:50:03.305815 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-d589e6ee-0c00-4f93-bc4a-7a63517d0190 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:03.306497 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-d589e6ee-0c00-4f93-bc4a-7a63517d0190 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 6b648e87-b71a-4ef3-aada-f884b8efb154] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:03.313030 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-d589e6ee-0c00-4f93-bc4a-7a63517d0190 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:03.313485 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-d589e6ee-0c00-4f93-bc4a-7a63517d0190 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:03.314255 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-d589e6ee-0c00-4f93-bc4a-7a63517d0190 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:03.314734 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-d589e6ee-0c00-4f93-bc4a-7a63517d0190 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:03.445742 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-d589e6ee-0c00-4f93-bc4a-7a63517d0190 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:03.453841 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-d589e6ee-0c00-4f93-bc4a-7a63517d0190 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154" status: 200 len: 1734 microversion: 2.1 time: 0.151869 Jun 23 11:50:03.454408 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 293/621] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:50:03 2022] GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:50:04.245474 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-8ed17d06-3657-43ae-8650-2f35c613b118 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:04.246246 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-8ed17d06-3657-43ae-8650-2f35c613b118 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:04.254941 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-8ed17d06-3657-43ae-8650-2f35c613b118 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:04.255393 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-8ed17d06-3657-43ae-8650-2f35c613b118 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:04.256208 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-8ed17d06-3657-43ae-8650-2f35c613b118 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:04.256635 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-8ed17d06-3657-43ae-8650-2f35c613b118 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:04.399685 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-8ed17d06-3657-43ae-8650-2f35c613b118 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:04.405642 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-8ed17d06-3657-43ae-8650-2f35c613b118 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:04.407188 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-8ed17d06-3657-43ae-8650-2f35c613b118 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:04.408373 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-8ed17d06-3657-43ae-8650-2f35c613b118 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1805 microversion: 2.20 time: 0.167233 Jun 23 11:50:04.408927 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 329/622] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:50:04 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1805 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:50:04.472239 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-dead1a7a-7367-4950-a9ad-a590717d0875 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:04.472886 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-dead1a7a-7367-4950-a9ad-a590717d0875 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 6b648e87-b71a-4ef3-aada-f884b8efb154] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:04.480023 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-dead1a7a-7367-4950-a9ad-a590717d0875 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:04.480478 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-dead1a7a-7367-4950-a9ad-a590717d0875 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:04.481245 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-dead1a7a-7367-4950-a9ad-a590717d0875 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:04.481685 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-dead1a7a-7367-4950-a9ad-a590717d0875 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:04.618952 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-dead1a7a-7367-4950-a9ad-a590717d0875 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:04.626922 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-dead1a7a-7367-4950-a9ad-a590717d0875 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154" status: 200 len: 1734 microversion: 2.1 time: 0.158581 Jun 23 11:50:04.627486 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 294/623] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:50:04 2022] GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154 => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:50:05.428766 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-a0d50868-ef54-4a99-9ffc-fa45e4aee8e9 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:05.430148 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-a0d50868-ef54-4a99-9ffc-fa45e4aee8e9 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:05.437736 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a0d50868-ef54-4a99-9ffc-fa45e4aee8e9 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:05.438176 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a0d50868-ef54-4a99-9ffc-fa45e4aee8e9 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:05.438975 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a0d50868-ef54-4a99-9ffc-fa45e4aee8e9 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:05.439421 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a0d50868-ef54-4a99-9ffc-fa45e4aee8e9 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:05.615749 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-a0d50868-ef54-4a99-9ffc-fa45e4aee8e9 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:05.625440 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-a0d50868-ef54-4a99-9ffc-fa45e4aee8e9 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:05.626961 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-a0d50868-ef54-4a99-9ffc-fa45e4aee8e9 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:05.628333 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-a0d50868-ef54-4a99-9ffc-fa45e4aee8e9 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1805 microversion: 2.20 time: 0.204542 Jun 23 11:50:05.628878 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 330/624] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:50:05 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1805 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:50:05.644496 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-a391041c-64cd-40ac-b930-a0ca6c03921e tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:05.645112 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-a391041c-64cd-40ac-b930-a0ca6c03921e tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 6b648e87-b71a-4ef3-aada-f884b8efb154] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:05.652847 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-a391041c-64cd-40ac-b930-a0ca6c03921e tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:05.653304 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-a391041c-64cd-40ac-b930-a0ca6c03921e tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:05.654083 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-a391041c-64cd-40ac-b930-a0ca6c03921e tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:05.654525 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-a391041c-64cd-40ac-b930-a0ca6c03921e tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:05.659028 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:50:05.811331 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-a391041c-64cd-40ac-b930-a0ca6c03921e tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:05.820048 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-a391041c-64cd-40ac-b930-a0ca6c03921e tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154" status: 200 len: 1734 microversion: 2.1 time: 0.179255 Jun 23 11:50:05.821276 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 295/625] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:50:05 2022] GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154 => generated 1734 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:50:06.649458 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-239bbe79-02b9-4cb4-b983-42659e3d60cb tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:06.650692 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-239bbe79-02b9-4cb4-b983-42659e3d60cb tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:06.657444 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-239bbe79-02b9-4cb4-b983-42659e3d60cb tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:06.657974 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-239bbe79-02b9-4cb4-b983-42659e3d60cb tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:06.658971 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-239bbe79-02b9-4cb4-b983-42659e3d60cb tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:06.659573 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-239bbe79-02b9-4cb4-b983-42659e3d60cb tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:06.822987 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-239bbe79-02b9-4cb4-b983-42659e3d60cb tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:06.831749 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-239bbe79-02b9-4cb4-b983-42659e3d60cb tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:06.833267 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-239bbe79-02b9-4cb4-b983-42659e3d60cb tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:06.834602 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-239bbe79-02b9-4cb4-b983-42659e3d60cb tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1805 microversion: 2.20 time: 0.189493 Jun 23 11:50:06.835669 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 331/626] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:50:06 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1805 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:50:06.838343 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-0be78f1b-d60f-4e47-84e4-5b60a64086be tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:06.838982 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-0be78f1b-d60f-4e47-84e4-5b60a64086be tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 6b648e87-b71a-4ef3-aada-f884b8efb154] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:06.846211 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-0be78f1b-d60f-4e47-84e4-5b60a64086be tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:06.846690 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-0be78f1b-d60f-4e47-84e4-5b60a64086be tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:06.847465 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-0be78f1b-d60f-4e47-84e4-5b60a64086be tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:06.847899 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-0be78f1b-d60f-4e47-84e4-5b60a64086be tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:06.987019 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-0be78f1b-d60f-4e47-84e4-5b60a64086be tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:06.998650 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-0be78f1b-d60f-4e47-84e4-5b60a64086be tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154" status: 200 len: 1734 microversion: 2.1 time: 0.164906 Jun 23 11:50:06.999253 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 296/627] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:50:06 2022] GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154 => generated 1734 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:50:07.856573 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-41ddd7de-534b-44b2-9a28-930f6fa1a023 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:07.858357 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-41ddd7de-534b-44b2-9a28-930f6fa1a023 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:07.865293 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-41ddd7de-534b-44b2-9a28-930f6fa1a023 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:07.866927 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-41ddd7de-534b-44b2-9a28-930f6fa1a023 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:07.868462 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-41ddd7de-534b-44b2-9a28-930f6fa1a023 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:07.868910 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-41ddd7de-534b-44b2-9a28-930f6fa1a023 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:08.020696 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-76455744-0c18-4c77-ac99-428f6403db92 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:08.021978 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-76455744-0c18-4c77-ac99-428f6403db92 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 6b648e87-b71a-4ef3-aada-f884b8efb154] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:08.029992 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-41ddd7de-534b-44b2-9a28-930f6fa1a023 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:08.032902 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-76455744-0c18-4c77-ac99-428f6403db92 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:08.035283 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-76455744-0c18-4c77-ac99-428f6403db92 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:08.036970 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-76455744-0c18-4c77-ac99-428f6403db92 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:08.037851 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-76455744-0c18-4c77-ac99-428f6403db92 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:08.057142 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-41ddd7de-534b-44b2-9a28-930f6fa1a023 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:08.059015 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-41ddd7de-534b-44b2-9a28-930f6fa1a023 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:08.060318 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-41ddd7de-534b-44b2-9a28-930f6fa1a023 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1805 microversion: 2.20 time: 0.209104 Jun 23 11:50:08.061534 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 332/628] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:50:07 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1805 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:50:08.189027 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-76455744-0c18-4c77-ac99-428f6403db92 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:08.197791 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-76455744-0c18-4c77-ac99-428f6403db92 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154" status: 200 len: 1734 microversion: 2.1 time: 0.182603 Jun 23 11:50:08.198368 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 297/629] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:50:08 2022] GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154 => generated 1734 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:50:09.081366 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-0cb7a15e-1df1-4e23-8e89-55a2e5648e2c tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:09.081967 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-0cb7a15e-1df1-4e23-8e89-55a2e5648e2c tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:09.090082 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-0cb7a15e-1df1-4e23-8e89-55a2e5648e2c tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:09.090978 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-0cb7a15e-1df1-4e23-8e89-55a2e5648e2c tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:09.091930 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-0cb7a15e-1df1-4e23-8e89-55a2e5648e2c tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:09.092362 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-0cb7a15e-1df1-4e23-8e89-55a2e5648e2c tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:09.217036 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-022bef52-8a3b-4e23-8d1f-f91f2334a9dd tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:09.219765 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-022bef52-8a3b-4e23-8d1f-f91f2334a9dd tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 6b648e87-b71a-4ef3-aada-f884b8efb154] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:09.234824 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-022bef52-8a3b-4e23-8d1f-f91f2334a9dd tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:09.235649 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-022bef52-8a3b-4e23-8d1f-f91f2334a9dd tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:09.237737 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-022bef52-8a3b-4e23-8d1f-f91f2334a9dd tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:09.239480 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-022bef52-8a3b-4e23-8d1f-f91f2334a9dd tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:09.285835 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-0cb7a15e-1df1-4e23-8e89-55a2e5648e2c tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:09.300663 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-0cb7a15e-1df1-4e23-8e89-55a2e5648e2c tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:09.304183 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-0cb7a15e-1df1-4e23-8e89-55a2e5648e2c tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:09.308264 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-0cb7a15e-1df1-4e23-8e89-55a2e5648e2c tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1805 microversion: 2.20 time: 0.230757 Jun 23 11:50:09.313911 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 333/630] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:50:09 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1805 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:50:09.449715 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-022bef52-8a3b-4e23-8d1f-f91f2334a9dd tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:09.462845 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-022bef52-8a3b-4e23-8d1f-f91f2334a9dd tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154" status: 200 len: 1734 microversion: 2.1 time: 0.251720 Jun 23 11:50:09.465393 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 298/631] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:50:09 2022] GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154 => generated 1734 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:50:10.333702 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-d5fc428e-0403-4c59-84b8-d999ac69abe8 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:10.334444 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-d5fc428e-0403-4c59-84b8-d999ac69abe8 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:10.341284 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-d5fc428e-0403-4c59-84b8-d999ac69abe8 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:10.341711 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-d5fc428e-0403-4c59-84b8-d999ac69abe8 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:10.342465 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-d5fc428e-0403-4c59-84b8-d999ac69abe8 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:10.343183 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-d5fc428e-0403-4c59-84b8-d999ac69abe8 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:10.482103 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-2051d8f7-1934-4d44-9189-c1ea1396f5f3 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:10.482808 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-d5fc428e-0403-4c59-84b8-d999ac69abe8 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:10.482923 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-2051d8f7-1934-4d44-9189-c1ea1396f5f3 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 6b648e87-b71a-4ef3-aada-f884b8efb154] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:10.489615 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-2051d8f7-1934-4d44-9189-c1ea1396f5f3 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:10.491086 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-2051d8f7-1934-4d44-9189-c1ea1396f5f3 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:10.492670 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-2051d8f7-1934-4d44-9189-c1ea1396f5f3 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:10.493701 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-2051d8f7-1934-4d44-9189-c1ea1396f5f3 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:10.502743 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-d5fc428e-0403-4c59-84b8-d999ac69abe8 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:10.504238 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-d5fc428e-0403-4c59-84b8-d999ac69abe8 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:10.505395 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-d5fc428e-0403-4c59-84b8-d999ac69abe8 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1805 microversion: 2.20 time: 0.175690 Jun 23 11:50:10.513029 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 334/632] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:50:10 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1805 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:50:10.638796 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-2051d8f7-1934-4d44-9189-c1ea1396f5f3 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:10.646962 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-2051d8f7-1934-4d44-9189-c1ea1396f5f3 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154" status: 200 len: 1734 microversion: 2.1 time: 0.169103 Jun 23 11:50:10.658009 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 299/633] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:50:10 2022] GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154 => generated 1734 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:50:11.525637 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-72f1bbaa-4c0f-4ca7-96e9-e5a7fc9abf45 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:11.526923 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-72f1bbaa-4c0f-4ca7-96e9-e5a7fc9abf45 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:11.533222 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-72f1bbaa-4c0f-4ca7-96e9-e5a7fc9abf45 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:11.533841 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-72f1bbaa-4c0f-4ca7-96e9-e5a7fc9abf45 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:11.534620 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-72f1bbaa-4c0f-4ca7-96e9-e5a7fc9abf45 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:11.535044 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-72f1bbaa-4c0f-4ca7-96e9-e5a7fc9abf45 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:11.667509 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-3fe93774-3dd0-4a3b-adcd-11eabc13fdae tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:11.668885 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-3fe93774-3dd0-4a3b-adcd-11eabc13fdae tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 6b648e87-b71a-4ef3-aada-f884b8efb154] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:11.675815 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_api:SELECT=40 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:50:11.677697 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-3fe93774-3dd0-4a3b-adcd-11eabc13fdae tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:11.678224 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-3fe93774-3dd0-4a3b-adcd-11eabc13fdae tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:11.679115 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-3fe93774-3dd0-4a3b-adcd-11eabc13fdae tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:11.679655 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-3fe93774-3dd0-4a3b-adcd-11eabc13fdae tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:11.691441 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-72f1bbaa-4c0f-4ca7-96e9-e5a7fc9abf45 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:11.708417 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-72f1bbaa-4c0f-4ca7-96e9-e5a7fc9abf45 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:11.710383 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-72f1bbaa-4c0f-4ca7-96e9-e5a7fc9abf45 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:11.712740 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-72f1bbaa-4c0f-4ca7-96e9-e5a7fc9abf45 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1805 microversion: 2.20 time: 0.192207 Jun 23 11:50:11.724742 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 335/634] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:50:11 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1805 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:50:11.835383 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-3fe93774-3dd0-4a3b-adcd-11eabc13fdae tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:11.845114 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-3fe93774-3dd0-4a3b-adcd-11eabc13fdae tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154" status: 200 len: 1734 microversion: 2.1 time: 0.183162 Jun 23 11:50:11.845781 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 300/635] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:50:11 2022] GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154 => generated 1734 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:50:12.741617 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-dbb4ce5b-c228-4ff1-824f-b5c62d7aeafa tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:12.742414 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-dbb4ce5b-c228-4ff1-824f-b5c62d7aeafa tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:12.744977 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_api:SELECT=40 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:50:12.749793 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-dbb4ce5b-c228-4ff1-824f-b5c62d7aeafa tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:12.750236 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-dbb4ce5b-c228-4ff1-824f-b5c62d7aeafa tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:12.751049 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-dbb4ce5b-c228-4ff1-824f-b5c62d7aeafa tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:12.751475 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-dbb4ce5b-c228-4ff1-824f-b5c62d7aeafa tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:12.863049 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-9f3bd827-aace-476c-9956-0774a4e12228 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:12.869307 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-9f3bd827-aace-476c-9956-0774a4e12228 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 6b648e87-b71a-4ef3-aada-f884b8efb154] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:12.871166 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-9f3bd827-aace-476c-9956-0774a4e12228 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:12.871704 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-9f3bd827-aace-476c-9956-0774a4e12228 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:12.872521 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-9f3bd827-aace-476c-9956-0774a4e12228 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:12.872958 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-9f3bd827-aace-476c-9956-0774a4e12228 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:12.911380 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-dbb4ce5b-c228-4ff1-824f-b5c62d7aeafa tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:12.923277 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-dbb4ce5b-c228-4ff1-824f-b5c62d7aeafa tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:12.926784 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-dbb4ce5b-c228-4ff1-824f-b5c62d7aeafa tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:12.926784 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-dbb4ce5b-c228-4ff1-824f-b5c62d7aeafa tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1805 microversion: 2.20 time: 0.192565 Jun 23 11:50:12.937682 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 336/636] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:50:12 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1805 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:50:13.024840 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-9f3bd827-aace-476c-9956-0774a4e12228 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:13.034575 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-9f3bd827-aace-476c-9956-0774a4e12228 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154" status: 200 len: 1734 microversion: 2.1 time: 0.175307 Jun 23 11:50:13.036248 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 301/637] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:50:12 2022] GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154 => generated 1734 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:50:13.944941 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-e219685b-8089-4e86-9c32-1ff9377b3a06 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:13.945606 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-e219685b-8089-4e86-9c32-1ff9377b3a06 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:13.952347 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-e219685b-8089-4e86-9c32-1ff9377b3a06 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:13.952790 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-e219685b-8089-4e86-9c32-1ff9377b3a06 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:13.953673 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-e219685b-8089-4e86-9c32-1ff9377b3a06 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:13.954105 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-e219685b-8089-4e86-9c32-1ff9377b3a06 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:13.971198 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=96,nova_cell1:UPDATE=2 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:50:14.052321 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-cbdd5993-50ca-4485-952d-17c72cb17aaf tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:14.053168 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-cbdd5993-50ca-4485-952d-17c72cb17aaf tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 6b648e87-b71a-4ef3-aada-f884b8efb154] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:14.059772 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-cbdd5993-50ca-4485-952d-17c72cb17aaf tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:14.060229 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-cbdd5993-50ca-4485-952d-17c72cb17aaf tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:14.061244 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-cbdd5993-50ca-4485-952d-17c72cb17aaf tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:14.061681 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-cbdd5993-50ca-4485-952d-17c72cb17aaf tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:14.093298 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-e219685b-8089-4e86-9c32-1ff9377b3a06 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:14.102451 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-e219685b-8089-4e86-9c32-1ff9377b3a06 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:14.103901 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-e219685b-8089-4e86-9c32-1ff9377b3a06 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:14.105054 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-e219685b-8089-4e86-9c32-1ff9377b3a06 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1805 microversion: 2.20 time: 0.164077 Jun 23 11:50:14.105623 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 337/638] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:50:13 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1805 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:50:14.193409 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-cbdd5993-50ca-4485-952d-17c72cb17aaf tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:14.201242 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-cbdd5993-50ca-4485-952d-17c72cb17aaf tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154" status: 200 len: 1734 microversion: 2.1 time: 0.152741 Jun 23 11:50:14.201798 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 302/639] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:50:14 2022] GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:50:15.128798 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-3cf01c1d-a3b4-4f13-bac4-4e082a7d5f51 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:15.129389 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-3cf01c1d-a3b4-4f13-bac4-4e082a7d5f51 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:15.136442 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-3cf01c1d-a3b4-4f13-bac4-4e082a7d5f51 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:15.136878 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-3cf01c1d-a3b4-4f13-bac4-4e082a7d5f51 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:15.137621 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-3cf01c1d-a3b4-4f13-bac4-4e082a7d5f51 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:15.138054 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-3cf01c1d-a3b4-4f13-bac4-4e082a7d5f51 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:15.219625 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-e5ed2fa7-e8cc-43f0-a654-78ffe2ec39fd tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:15.220229 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-e5ed2fa7-e8cc-43f0-a654-78ffe2ec39fd tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 6b648e87-b71a-4ef3-aada-f884b8efb154] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:15.227197 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-e5ed2fa7-e8cc-43f0-a654-78ffe2ec39fd tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:15.227197 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-e5ed2fa7-e8cc-43f0-a654-78ffe2ec39fd tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:15.228331 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-e5ed2fa7-e8cc-43f0-a654-78ffe2ec39fd tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:15.228759 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-e5ed2fa7-e8cc-43f0-a654-78ffe2ec39fd tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:15.276907 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-3cf01c1d-a3b4-4f13-bac4-4e082a7d5f51 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:15.285225 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-3cf01c1d-a3b4-4f13-bac4-4e082a7d5f51 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:15.286750 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-3cf01c1d-a3b4-4f13-bac4-4e082a7d5f51 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:15.287927 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-3cf01c1d-a3b4-4f13-bac4-4e082a7d5f51 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1805 microversion: 2.20 time: 0.163074 Jun 23 11:50:15.288477 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 338/640] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:50:15 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1805 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:50:15.361610 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-e5ed2fa7-e8cc-43f0-a654-78ffe2ec39fd tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:15.370565 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-e5ed2fa7-e8cc-43f0-a654-78ffe2ec39fd tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154" status: 200 len: 1734 microversion: 2.1 time: 0.155131 Jun 23 11:50:15.371126 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 303/641] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:50:15 2022] GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:50:16.307399 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-c4c09a45-e986-4a1d-845b-376132381df0 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:16.308002 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-c4c09a45-e986-4a1d-845b-376132381df0 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:16.314343 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-c4c09a45-e986-4a1d-845b-376132381df0 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:16.314832 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-c4c09a45-e986-4a1d-845b-376132381df0 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:16.315576 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-c4c09a45-e986-4a1d-845b-376132381df0 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:16.316008 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-c4c09a45-e986-4a1d-845b-376132381df0 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:16.387509 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-7ad4a56b-82a9-4409-8f31-eb86767e119d tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:16.388179 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-7ad4a56b-82a9-4409-8f31-eb86767e119d tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 6b648e87-b71a-4ef3-aada-f884b8efb154] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:16.394977 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-7ad4a56b-82a9-4409-8f31-eb86767e119d tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:16.395439 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-7ad4a56b-82a9-4409-8f31-eb86767e119d tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:16.396215 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-7ad4a56b-82a9-4409-8f31-eb86767e119d tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:16.396662 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-7ad4a56b-82a9-4409-8f31-eb86767e119d tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:16.479044 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-c4c09a45-e986-4a1d-845b-376132381df0 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:16.493957 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-c4c09a45-e986-4a1d-845b-376132381df0 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:16.500212 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-c4c09a45-e986-4a1d-845b-376132381df0 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:16.501972 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-c4c09a45-e986-4a1d-845b-376132381df0 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1805 microversion: 2.20 time: 0.198972 Jun 23 11:50:16.503368 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 339/642] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:50:16 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1805 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:50:16.587522 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-7ad4a56b-82a9-4409-8f31-eb86767e119d tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:16.595740 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-7ad4a56b-82a9-4409-8f31-eb86767e119d tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154" status: 200 len: 1734 microversion: 2.1 time: 0.212846 Jun 23 11:50:16.596300 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 304/643] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:50:16 2022] GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154 => generated 1734 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:50:17.520502 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-a026dc07-1b33-41a6-894a-bdc065daf1b3 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:17.521099 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-a026dc07-1b33-41a6-894a-bdc065daf1b3 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:17.527984 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a026dc07-1b33-41a6-894a-bdc065daf1b3 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:17.528454 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a026dc07-1b33-41a6-894a-bdc065daf1b3 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:17.529205 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a026dc07-1b33-41a6-894a-bdc065daf1b3 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:17.529627 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a026dc07-1b33-41a6-894a-bdc065daf1b3 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:17.613100 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-2598f776-f673-4b2e-8e0a-c8547c4bd319 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:17.613787 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-2598f776-f673-4b2e-8e0a-c8547c4bd319 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 6b648e87-b71a-4ef3-aada-f884b8efb154] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:17.620524 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-2598f776-f673-4b2e-8e0a-c8547c4bd319 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:17.621055 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-2598f776-f673-4b2e-8e0a-c8547c4bd319 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:17.621892 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-2598f776-f673-4b2e-8e0a-c8547c4bd319 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:17.622402 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-2598f776-f673-4b2e-8e0a-c8547c4bd319 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:17.658655 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-a026dc07-1b33-41a6-894a-bdc065daf1b3 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:17.667115 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-a026dc07-1b33-41a6-894a-bdc065daf1b3 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:17.668626 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-a026dc07-1b33-41a6-894a-bdc065daf1b3 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:17.669788 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-a026dc07-1b33-41a6-894a-bdc065daf1b3 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1805 microversion: 2.20 time: 0.153197 Jun 23 11:50:17.670349 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 340/644] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:50:17 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1805 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:50:17.750880 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-2598f776-f673-4b2e-8e0a-c8547c4bd319 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:17.759872 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-2598f776-f673-4b2e-8e0a-c8547c4bd319 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154" status: 200 len: 1734 microversion: 2.1 time: 0.150579 Jun 23 11:50:17.760430 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 305/645] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:50:17 2022] GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:50:18.689073 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-c7031278-b0f7-42b7-88b7-8cbbba6b09ba tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:18.689704 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-c7031278-b0f7-42b7-88b7-8cbbba6b09ba tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:18.696135 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-c7031278-b0f7-42b7-88b7-8cbbba6b09ba tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:18.713655 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-c7031278-b0f7-42b7-88b7-8cbbba6b09ba tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:18.713655 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-c7031278-b0f7-42b7-88b7-8cbbba6b09ba tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:18.713655 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-c7031278-b0f7-42b7-88b7-8cbbba6b09ba tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:18.777583 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-34ecc2df-1fad-488c-8013-e2e45b207f0c tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:18.778231 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-34ecc2df-1fad-488c-8013-e2e45b207f0c tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 6b648e87-b71a-4ef3-aada-f884b8efb154] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:18.786896 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-34ecc2df-1fad-488c-8013-e2e45b207f0c tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:18.787428 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-34ecc2df-1fad-488c-8013-e2e45b207f0c tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:18.788454 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-34ecc2df-1fad-488c-8013-e2e45b207f0c tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:18.789064 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-34ecc2df-1fad-488c-8013-e2e45b207f0c tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:18.837514 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-c7031278-b0f7-42b7-88b7-8cbbba6b09ba tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:18.846363 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-c7031278-b0f7-42b7-88b7-8cbbba6b09ba tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:18.847874 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-c7031278-b0f7-42b7-88b7-8cbbba6b09ba tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:18.849023 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-c7031278-b0f7-42b7-88b7-8cbbba6b09ba tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1805 microversion: 2.20 time: 0.164028 Jun 23 11:50:18.849760 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 341/646] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:50:18 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1805 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:50:18.943443 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-34ecc2df-1fad-488c-8013-e2e45b207f0c tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:18.954575 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-34ecc2df-1fad-488c-8013-e2e45b207f0c tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154" status: 200 len: 1734 microversion: 2.1 time: 0.181094 Jun 23 11:50:18.965526 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 306/647] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:50:18 2022] GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154 => generated 1734 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:50:19.873083 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-60c0be18-963c-46d6-b981-d511d1cb5ee8 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:19.873722 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-60c0be18-963c-46d6-b981-d511d1cb5ee8 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:19.880589 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-60c0be18-963c-46d6-b981-d511d1cb5ee8 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:19.881163 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-60c0be18-963c-46d6-b981-d511d1cb5ee8 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:19.882046 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-60c0be18-963c-46d6-b981-d511d1cb5ee8 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:19.882610 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-60c0be18-963c-46d6-b981-d511d1cb5ee8 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:19.981880 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-7a664218-e256-4a51-a943-500285119efa tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:19.983621 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-7a664218-e256-4a51-a943-500285119efa tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 6b648e87-b71a-4ef3-aada-f884b8efb154] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:19.990804 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-7a664218-e256-4a51-a943-500285119efa tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:19.991598 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-7a664218-e256-4a51-a943-500285119efa tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:19.992643 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-7a664218-e256-4a51-a943-500285119efa tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:19.993416 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-7a664218-e256-4a51-a943-500285119efa tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:20.036738 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-60c0be18-963c-46d6-b981-d511d1cb5ee8 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:20.047701 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-60c0be18-963c-46d6-b981-d511d1cb5ee8 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:20.049182 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-60c0be18-963c-46d6-b981-d511d1cb5ee8 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:20.050578 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-60c0be18-963c-46d6-b981-d511d1cb5ee8 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1805 microversion: 2.20 time: 0.181283 Jun 23 11:50:20.051243 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 342/648] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:50:19 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1805 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:50:20.130552 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-7a664218-e256-4a51-a943-500285119efa tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:20.138764 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-7a664218-e256-4a51-a943-500285119efa tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154" status: 200 len: 1734 microversion: 2.1 time: 0.160783 Jun 23 11:50:20.139328 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 307/649] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:50:19 2022] GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154 => generated 1734 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:50:20.529716 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-970f8618-de06-41a4-b9fa-5c466417ec20 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:50:20.530246 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-970f8618-de06-41a4-b9fa-5c466417ec20 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] [instance: c026366c-311a-45eb-899c-30703cd7eb1d] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:20.536415 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-970f8618-de06-41a4-b9fa-5c466417ec20 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:20.536852 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-970f8618-de06-41a4-b9fa-5c466417ec20 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:20.537604 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-970f8618-de06-41a4-b9fa-5c466417ec20 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:20.538030 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-970f8618-de06-41a4-b9fa-5c466417ec20 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:20.559579 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.objects.instance [None req-970f8618-de06-41a4-b9fa-5c466417ec20 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lazy-loading 'flavor' on Instance uuid c026366c-311a-45eb-899c-30703cd7eb1d {{(pid=124670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:50:20.825865 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-970f8618-de06-41a4-b9fa-5c466417ec20 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] 10.222.0.13 "POST /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d/action" status: 202 len: 0 microversion: 2.1 time: 0.299792 Jun 23 11:50:20.826666 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 343/650] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Jun 23 11:50:20 2022] POST /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d/action => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 11:50:20.834713 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-ceb9ef5c-8ed5-46cb-b2c8-2b4d73f2a190 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:20.835320 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-ceb9ef5c-8ed5-46cb-b2c8-2b4d73f2a190 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] [instance: c026366c-311a-45eb-899c-30703cd7eb1d] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:20.842026 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ceb9ef5c-8ed5-46cb-b2c8-2b4d73f2a190 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:20.842553 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ceb9ef5c-8ed5-46cb-b2c8-2b4d73f2a190 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:20.843570 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ceb9ef5c-8ed5-46cb-b2c8-2b4d73f2a190 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:20.844002 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ceb9ef5c-8ed5-46cb-b2c8-2b4d73f2a190 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:20.970693 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-ceb9ef5c-8ed5-46cb-b2c8-2b4d73f2a190 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626c3dbdc0f1407db82d6988e68e40b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce01d9a78d3f4bb7b101b47548b73037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:20.978088 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-ceb9ef5c-8ed5-46cb-b2c8-2b4d73f2a190 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] 10.222.0.13 "GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d" status: 200 len: 1568 microversion: 2.1 time: 0.147242 Jun 23 11:50:20.978664 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 308/651] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:50:20 2022] GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:50:21.068923 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-22be387f-2dbb-4e6a-bf1a-e2c58a331b8e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:21.070288 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-22be387f-2dbb-4e6a-bf1a-e2c58a331b8e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:21.077866 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-22be387f-2dbb-4e6a-bf1a-e2c58a331b8e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:21.078245 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-22be387f-2dbb-4e6a-bf1a-e2c58a331b8e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:21.079027 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-22be387f-2dbb-4e6a-bf1a-e2c58a331b8e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:21.079454 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-22be387f-2dbb-4e6a-bf1a-e2c58a331b8e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:21.155903 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-a25888c7-20ee-4140-973c-3ea0f40e925a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:21.156508 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-a25888c7-20ee-4140-973c-3ea0f40e925a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 6b648e87-b71a-4ef3-aada-f884b8efb154] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:21.163176 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-a25888c7-20ee-4140-973c-3ea0f40e925a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:21.163634 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-a25888c7-20ee-4140-973c-3ea0f40e925a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:21.164915 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-a25888c7-20ee-4140-973c-3ea0f40e925a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:21.165351 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-a25888c7-20ee-4140-973c-3ea0f40e925a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:21.225501 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-22be387f-2dbb-4e6a-bf1a-e2c58a331b8e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:21.234952 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-22be387f-2dbb-4e6a-bf1a-e2c58a331b8e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:21.236556 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-22be387f-2dbb-4e6a-bf1a-e2c58a331b8e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:21.237826 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-22be387f-2dbb-4e6a-bf1a-e2c58a331b8e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1805 microversion: 2.20 time: 0.173225 Jun 23 11:50:21.238392 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 344/652] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:50:21 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1805 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:50:21.385848 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-a25888c7-20ee-4140-973c-3ea0f40e925a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:21.385848 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-a25888c7-20ee-4140-973c-3ea0f40e925a tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154" status: 200 len: 1734 microversion: 2.1 time: 0.169509 Jun 23 11:50:21.385848 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 309/653] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:50:21 2022] GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154 => generated 1734 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:50:21.995270 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-786c2bc4-17ed-43ac-9b0d-7fb2bb9aafeb tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:21.995868 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-786c2bc4-17ed-43ac-9b0d-7fb2bb9aafeb tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] [instance: c026366c-311a-45eb-899c-30703cd7eb1d] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:22.001874 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-786c2bc4-17ed-43ac-9b0d-7fb2bb9aafeb tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:22.002315 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-786c2bc4-17ed-43ac-9b0d-7fb2bb9aafeb tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:22.003098 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-786c2bc4-17ed-43ac-9b0d-7fb2bb9aafeb tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:22.003530 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-786c2bc4-17ed-43ac-9b0d-7fb2bb9aafeb tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:22.139219 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-786c2bc4-17ed-43ac-9b0d-7fb2bb9aafeb tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626c3dbdc0f1407db82d6988e68e40b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce01d9a78d3f4bb7b101b47548b73037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:22.146706 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-786c2bc4-17ed-43ac-9b0d-7fb2bb9aafeb tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] 10.222.0.13 "GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d" status: 200 len: 1568 microversion: 2.1 time: 0.155720 Jun 23 11:50:22.147505 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 345/654] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:50:21 2022] GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:50:22.257082 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-85319550-d701-45a3-8479-99be2dbf0f99 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:22.257620 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-85319550-d701-45a3-8479-99be2dbf0f99 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:22.264452 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-85319550-d701-45a3-8479-99be2dbf0f99 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:22.268316 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-85319550-d701-45a3-8479-99be2dbf0f99 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:22.268316 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-85319550-d701-45a3-8479-99be2dbf0f99 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:22.268316 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-85319550-d701-45a3-8479-99be2dbf0f99 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:22.339126 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-846455cd-e6ac-418a-b1f8-5048e05a69ea tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:22.339968 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-846455cd-e6ac-418a-b1f8-5048e05a69ea tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 6b648e87-b71a-4ef3-aada-f884b8efb154] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:22.346130 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-846455cd-e6ac-418a-b1f8-5048e05a69ea tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:22.346592 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-846455cd-e6ac-418a-b1f8-5048e05a69ea tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:22.347341 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-846455cd-e6ac-418a-b1f8-5048e05a69ea tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:22.347764 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-846455cd-e6ac-418a-b1f8-5048e05a69ea tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:22.419244 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-85319550-d701-45a3-8479-99be2dbf0f99 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:22.427616 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-85319550-d701-45a3-8479-99be2dbf0f99 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:22.429105 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-85319550-d701-45a3-8479-99be2dbf0f99 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:22.430785 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-85319550-d701-45a3-8479-99be2dbf0f99 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1805 microversion: 2.20 time: 0.177761 Jun 23 11:50:22.431335 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 310/655] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:50:22 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1805 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:50:22.487682 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-846455cd-e6ac-418a-b1f8-5048e05a69ea tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:22.494685 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-846455cd-e6ac-418a-b1f8-5048e05a69ea tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154" status: 200 len: 1714 microversion: 2.1 time: 0.159913 Jun 23 11:50:22.495286 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 346/656] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:50:22 2022] GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154 => generated 1714 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:50:22.595289 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-f64bd9d1-9f12-4da9-bfa1-8e62868c19e4 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:22.595777 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-f64bd9d1-9f12-4da9-bfa1-8e62868c19e4 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 6b648e87-b71a-4ef3-aada-f884b8efb154] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:22.602182 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-f64bd9d1-9f12-4da9-bfa1-8e62868c19e4 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:22.602701 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-f64bd9d1-9f12-4da9-bfa1-8e62868c19e4 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:22.603455 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-f64bd9d1-9f12-4da9-bfa1-8e62868c19e4 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:22.603890 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-f64bd9d1-9f12-4da9-bfa1-8e62868c19e4 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:22.681300 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_cell1:SELECT=100 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:50:22.684888 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.wsgi [None req-f64bd9d1-9f12-4da9-bfa1-8e62868c19e4 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] HTTP exception thrown: Cannot 'detach_volume' instance 6b648e87-b71a-4ef3-aada-f884b8efb154 while it is in vm_state rescued Jun 23 11:50:22.686491 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-f64bd9d1-9f12-4da9-bfa1-8e62868c19e4 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Request method failure captured: Jun 23 11:50:22.686491 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: request: DELETE /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154/os-volume_attachments/ff87e09b-2262-45d8-aade-6673642c4a09 HTTP/1.1 Jun 23 11:50:22.686491 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Accept: application/json Jun 23 11:50:22.686491 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Accept-Encoding: identity Jun 23 11:50:22.686491 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Connection: close Jun 23 11:50:22.686491 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Content-Length: 0 Jun 23 11:50:22.686491 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Content-Type: application/json Jun 23 11:50:22.686491 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Host: 10.222.0.13 Jun 23 11:50:22.686491 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Openstack-System-Scope: None Jun 23 11:50:22.686491 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: User-Agent: python-urllib3/1.26.9 Jun 23 11:50:22.686491 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Auth-Token: gAAAAABitFIQMZzIonjUbfDwf8XrsOwiJZRU6mFcRB1-tnfeb_v3NOEweS__m4o1J8UHtu-_xrjURmrJ6fzG89APjTfsnyiQVFAZpTd13GqegTFfQ58YDG0ZJ0-BfSv3ftKHTlhdH_kG2HiseMXvNGBpCdtSjep9DwmxqUcu34-5A9JBS3aKDXY Jun 23 11:50:22.686491 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Domain-Id: None Jun 23 11:50:22.686491 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Domain-Name: None Jun 23 11:50:22.686491 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Identity-Status: Confirmed Jun 23 11:50:22.686491 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Is-Admin-Project: True Jun 23 11:50:22.686491 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Domain-Id: default Jun 23 11:50:22.686491 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Domain-Name: Default Jun 23 11:50:22.686491 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Id: b6241924efa944a68503a87b695c7410 Jun 23 11:50:22.686491 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-493570352 Jun 23 11:50:22.686491 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Role: member,reader Jun 23 11:50:22.686491 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Roles: member,reader Jun 23 11:50:22.688156 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b6241924efa944a68503a87b695c7410"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b6241924efa944a68503a87b695c7410"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b6241924efa944a68503a87b695c7410"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b6241924efa944a68503a87b695c7410"}]}] Jun 23 11:50:22.688156 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant: tempest-ServerRescueNegativeTestJSON-493570352 Jun 23 11:50:22.688156 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant-Id: b6241924efa944a68503a87b695c7410 Jun 23 11:50:22.688156 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-493570352 Jun 23 11:50:22.688156 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User: tempest-ServerRescueNegativeTestJSON-493570352-project Jun 23 11:50:22.688156 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Domain-Id: default Jun 23 11:50:22.688156 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Domain-Name: Default Jun 23 11:50:22.688156 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Id: bcd5fc6167654972868941ed28c327b6 Jun 23 11:50:22.688156 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Name: tempest-ServerRescueNegativeTestJSON-493570352-project Jun 23 11:50:22.688156 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: method: > Jun 23 11:50:22.688156 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: exception: Cannot 'detach_volume' instance 6b648e87-b71a-4ef3-aada-f884b8efb154 while it is in vm_state rescued Jun 23 11:50:22.688991 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: action_args: {'server_id': '6b648e87-b71a-4ef3-aada-f884b8efb154', 'id': 'ff87e09b-2262-45d8-aade-6673642c4a09'} Jun 23 11:50:22.688991 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:50:22.688991 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:50:22.688991 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 23 11:50:22.688991 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 23 11:50:22.688991 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 23 11:50:22.688991 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 23 11:50:22.688991 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 23 11:50:22.688991 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 23 11:50:22.688991 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6b648e87-b71a-4ef3-aada-f884b8efb154 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 23 11:50:22.688991 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:50:22.688991 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:50:22.688991 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:50:22.688991 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:50:22.688991 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:50:22.688991 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:50:22.688991 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:50:22.688991 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:50:22.688991 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:50:22.688991 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:50:22.690642 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 23 11:50:22.690642 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 23 11:50:22.690642 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 23 11:50:22.690642 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 23 11:50:22.690642 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 6b648e87-b71a-4ef3-aada-f884b8efb154 while it is in vm_state rescued Jun 23 11:50:22.690642 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:50:22.690642 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:50:22.690642 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:50:22.690642 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:50:22.690642 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:50:22.690642 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:50:22.690642 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:50:22.690642 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:50:22.690642 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 6b648e87-b71a-4ef3-aada-f884b8efb154 while it is in vm_state rescued Jun 23 11:50:22.690642 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:50:22.690642 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-f64bd9d1-9f12-4da9-bfa1-8e62868c19e4 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Returning 409 to user: Cannot 'detach_volume' instance 6b648e87-b71a-4ef3-aada-f884b8efb154 while it is in vm_state rescued {{(pid=124669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:50:22.692415 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-f64bd9d1-9f12-4da9-bfa1-8e62868c19e4 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "DELETE /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154/os-volume_attachments/ff87e09b-2262-45d8-aade-6673642c4a09" status: 409 len: 152 microversion: 2.1 time: 0.096830 Jun 23 11:50:22.692415 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 311/657] 10.222.0.13 () {58 vars in 1415 bytes} [Thu Jun 23 11:50:22 2022] DELETE /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154/os-volume_attachments/ff87e09b-2262-45d8-aade-6673642c4a09 => generated 152 bytes in 98 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 23 11:50:22.697719 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-658c3e4a-2961-4788-918b-c4e59ab5c10f tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:50:22.698239 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-658c3e4a-2961-4788-918b-c4e59ab5c10f tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 6b648e87-b71a-4ef3-aada-f884b8efb154] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:22.704234 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-658c3e4a-2961-4788-918b-c4e59ab5c10f tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:22.710379 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-658c3e4a-2961-4788-918b-c4e59ab5c10f tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:22.710379 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-658c3e4a-2961-4788-918b-c4e59ab5c10f tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:22.710379 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-658c3e4a-2961-4788-918b-c4e59ab5c10f tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:22.933956 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-658c3e4a-2961-4788-918b-c4e59ab5c10f tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "POST /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154/action" status: 202 len: 0 microversion: 2.1 time: 0.240461 Jun 23 11:50:22.934601 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 347/658] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Jun 23 11:50:22 2022] POST /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154/action => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 11:50:22.943028 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-974ce4fa-e784-48d7-bd5b-5cabf1b2bec1 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:22.943642 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-974ce4fa-e784-48d7-bd5b-5cabf1b2bec1 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 6b648e87-b71a-4ef3-aada-f884b8efb154] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:22.949851 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-974ce4fa-e784-48d7-bd5b-5cabf1b2bec1 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:22.950303 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-974ce4fa-e784-48d7-bd5b-5cabf1b2bec1 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:22.951084 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-974ce4fa-e784-48d7-bd5b-5cabf1b2bec1 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:22.951520 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-974ce4fa-e784-48d7-bd5b-5cabf1b2bec1 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:23.078090 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-974ce4fa-e784-48d7-bd5b-5cabf1b2bec1 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:23.086807 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-974ce4fa-e784-48d7-bd5b-5cabf1b2bec1 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154" status: 200 len: 1722 microversion: 2.1 time: 0.147312 Jun 23 11:50:23.087375 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 312/659] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:50:22 2022] GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154 => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:50:23.165682 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-ed4368ed-fdc2-465c-90fb-016a946988df tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:23.166396 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-ed4368ed-fdc2-465c-90fb-016a946988df tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] [instance: c026366c-311a-45eb-899c-30703cd7eb1d] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:23.172628 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-ed4368ed-fdc2-465c-90fb-016a946988df tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:23.173069 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-ed4368ed-fdc2-465c-90fb-016a946988df tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:23.173808 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-ed4368ed-fdc2-465c-90fb-016a946988df tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:23.174239 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-ed4368ed-fdc2-465c-90fb-016a946988df tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:23.305314 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-ed4368ed-fdc2-465c-90fb-016a946988df tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626c3dbdc0f1407db82d6988e68e40b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce01d9a78d3f4bb7b101b47548b73037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:23.312708 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-ed4368ed-fdc2-465c-90fb-016a946988df tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] 10.222.0.13 "GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d" status: 200 len: 1568 microversion: 2.1 time: 0.152463 Jun 23 11:50:23.313265 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 348/660] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:50:23 2022] GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:50:23.449430 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-dae9a222-cf49-4d1c-ae5b-30e204e0079c tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:23.450148 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-dae9a222-cf49-4d1c-ae5b-30e204e0079c tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:23.456671 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-dae9a222-cf49-4d1c-ae5b-30e204e0079c tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:23.457116 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-dae9a222-cf49-4d1c-ae5b-30e204e0079c tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:23.457869 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-dae9a222-cf49-4d1c-ae5b-30e204e0079c tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:23.458309 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-dae9a222-cf49-4d1c-ae5b-30e204e0079c tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:23.587845 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-dae9a222-cf49-4d1c-ae5b-30e204e0079c tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:23.596457 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-dae9a222-cf49-4d1c-ae5b-30e204e0079c tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:23.597996 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-dae9a222-cf49-4d1c-ae5b-30e204e0079c tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:23.599175 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-dae9a222-cf49-4d1c-ae5b-30e204e0079c tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1805 microversion: 2.20 time: 0.154125 Jun 23 11:50:23.599720 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 313/661] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:50:23 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1805 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:50:24.104868 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-45187080-d37e-429a-9c83-7c5d2d0ad0dc tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:24.105516 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-45187080-d37e-429a-9c83-7c5d2d0ad0dc tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 6b648e87-b71a-4ef3-aada-f884b8efb154] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:24.111627 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-45187080-d37e-429a-9c83-7c5d2d0ad0dc tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:24.112010 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-45187080-d37e-429a-9c83-7c5d2d0ad0dc tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:24.112757 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-45187080-d37e-429a-9c83-7c5d2d0ad0dc tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:24.113187 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-45187080-d37e-429a-9c83-7c5d2d0ad0dc tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:24.241143 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-45187080-d37e-429a-9c83-7c5d2d0ad0dc tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:24.249846 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-45187080-d37e-429a-9c83-7c5d2d0ad0dc tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154" status: 200 len: 1722 microversion: 2.1 time: 0.149401 Jun 23 11:50:24.250398 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 349/662] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:50:24 2022] GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:50:24.330469 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-44a23309-e1b4-4eca-9b37-dad0bca473f9 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:24.331129 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-44a23309-e1b4-4eca-9b37-dad0bca473f9 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] [instance: c026366c-311a-45eb-899c-30703cd7eb1d] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:24.337354 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-44a23309-e1b4-4eca-9b37-dad0bca473f9 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:24.337813 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-44a23309-e1b4-4eca-9b37-dad0bca473f9 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:24.338626 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-44a23309-e1b4-4eca-9b37-dad0bca473f9 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:24.339069 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-44a23309-e1b4-4eca-9b37-dad0bca473f9 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:24.472554 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-44a23309-e1b4-4eca-9b37-dad0bca473f9 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626c3dbdc0f1407db82d6988e68e40b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce01d9a78d3f4bb7b101b47548b73037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:24.480748 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-44a23309-e1b4-4eca-9b37-dad0bca473f9 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] 10.222.0.13 "GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d" status: 200 len: 1568 microversion: 2.1 time: 0.154107 Jun 23 11:50:24.481304 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 314/663] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:50:24 2022] GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:50:24.617716 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-9761760a-3a03-4f8d-8a0a-5fe59b672700 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:24.618434 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-9761760a-3a03-4f8d-8a0a-5fe59b672700 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:24.624523 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-9761760a-3a03-4f8d-8a0a-5fe59b672700 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:24.624964 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-9761760a-3a03-4f8d-8a0a-5fe59b672700 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:24.625725 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-9761760a-3a03-4f8d-8a0a-5fe59b672700 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:24.626156 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-9761760a-3a03-4f8d-8a0a-5fe59b672700 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:24.755983 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-9761760a-3a03-4f8d-8a0a-5fe59b672700 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:24.765374 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-9761760a-3a03-4f8d-8a0a-5fe59b672700 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:24.766903 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-9761760a-3a03-4f8d-8a0a-5fe59b672700 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:24.768055 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-9761760a-3a03-4f8d-8a0a-5fe59b672700 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1805 microversion: 2.20 time: 0.154487 Jun 23 11:50:24.768612 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 350/664] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:50:24 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1805 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:50:25.267497 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-fab22dad-cf5a-4652-840f-1fef63643c2d tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:25.268020 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-fab22dad-cf5a-4652-840f-1fef63643c2d tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 6b648e87-b71a-4ef3-aada-f884b8efb154] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:25.274509 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-fab22dad-cf5a-4652-840f-1fef63643c2d tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:25.274982 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-fab22dad-cf5a-4652-840f-1fef63643c2d tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:25.275731 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-fab22dad-cf5a-4652-840f-1fef63643c2d tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:25.276161 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-fab22dad-cf5a-4652-840f-1fef63643c2d tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:25.404730 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-fab22dad-cf5a-4652-840f-1fef63643c2d tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:25.412585 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-fab22dad-cf5a-4652-840f-1fef63643c2d tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154" status: 200 len: 1722 microversion: 2.1 time: 0.149013 Jun 23 11:50:25.413144 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 315/665] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:50:25 2022] GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154 => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:50:25.498168 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-04f5c441-6d74-47da-a81d-ac2df9b983e1 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:25.498793 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-04f5c441-6d74-47da-a81d-ac2df9b983e1 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] [instance: c026366c-311a-45eb-899c-30703cd7eb1d] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:25.504758 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-04f5c441-6d74-47da-a81d-ac2df9b983e1 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:25.505195 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-04f5c441-6d74-47da-a81d-ac2df9b983e1 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:25.505960 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-04f5c441-6d74-47da-a81d-ac2df9b983e1 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:25.506385 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-04f5c441-6d74-47da-a81d-ac2df9b983e1 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:25.510115 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:50:25.640490 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-04f5c441-6d74-47da-a81d-ac2df9b983e1 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626c3dbdc0f1407db82d6988e68e40b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce01d9a78d3f4bb7b101b47548b73037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:25.647986 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-04f5c441-6d74-47da-a81d-ac2df9b983e1 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] 10.222.0.13 "GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d" status: 200 len: 1568 microversion: 2.1 time: 0.153693 Jun 23 11:50:25.650803 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 351/666] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:50:25 2022] GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:50:25.786518 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-f0e02c20-d796-4474-bdd4-67a0a538b76c tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:25.787177 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-f0e02c20-d796-4474-bdd4-67a0a538b76c tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:25.794292 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-f0e02c20-d796-4474-bdd4-67a0a538b76c tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:25.794780 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-f0e02c20-d796-4474-bdd4-67a0a538b76c tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:25.795537 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-f0e02c20-d796-4474-bdd4-67a0a538b76c tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:25.795973 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-f0e02c20-d796-4474-bdd4-67a0a538b76c tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:25.924100 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-f0e02c20-d796-4474-bdd4-67a0a538b76c tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:25.932705 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-f0e02c20-d796-4474-bdd4-67a0a538b76c tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:25.934208 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-f0e02c20-d796-4474-bdd4-67a0a538b76c tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:25.935395 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-f0e02c20-d796-4474-bdd4-67a0a538b76c tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1805 microversion: 2.20 time: 0.152738 Jun 23 11:50:25.935950 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 316/667] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:50:25 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1805 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:50:26.429099 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-a398517e-c58c-4c63-a97a-932334772f29 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:26.429632 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-a398517e-c58c-4c63-a97a-932334772f29 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 6b648e87-b71a-4ef3-aada-f884b8efb154] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:26.435819 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a398517e-c58c-4c63-a97a-932334772f29 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:26.436267 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a398517e-c58c-4c63-a97a-932334772f29 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:26.437020 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a398517e-c58c-4c63-a97a-932334772f29 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:26.437450 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a398517e-c58c-4c63-a97a-932334772f29 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:26.576880 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-a398517e-c58c-4c63-a97a-932334772f29 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:26.584786 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-a398517e-c58c-4c63-a97a-932334772f29 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154" status: 200 len: 1722 microversion: 2.1 time: 0.159579 Jun 23 11:50:26.585337 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 352/668] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:50:26 2022] GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:50:26.665220 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-62a7563e-1482-4ef4-bfb6-6fa6228ae128 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:26.665837 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-62a7563e-1482-4ef4-bfb6-6fa6228ae128 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] [instance: c026366c-311a-45eb-899c-30703cd7eb1d] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:26.672068 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-62a7563e-1482-4ef4-bfb6-6fa6228ae128 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:26.672524 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-62a7563e-1482-4ef4-bfb6-6fa6228ae128 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:26.673294 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-62a7563e-1482-4ef4-bfb6-6fa6228ae128 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:26.673740 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-62a7563e-1482-4ef4-bfb6-6fa6228ae128 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:26.806644 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-62a7563e-1482-4ef4-bfb6-6fa6228ae128 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626c3dbdc0f1407db82d6988e68e40b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce01d9a78d3f4bb7b101b47548b73037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:26.814037 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-62a7563e-1482-4ef4-bfb6-6fa6228ae128 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] 10.222.0.13 "GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d" status: 200 len: 1568 microversion: 2.1 time: 0.152752 Jun 23 11:50:26.814619 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 317/669] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:50:26 2022] GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:50:26.953736 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-ab07f99f-55be-4504-acfd-f7e65891e1a8 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:26.954267 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-ab07f99f-55be-4504-acfd-f7e65891e1a8 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:26.960274 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-ab07f99f-55be-4504-acfd-f7e65891e1a8 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:26.960723 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-ab07f99f-55be-4504-acfd-f7e65891e1a8 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:26.961506 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-ab07f99f-55be-4504-acfd-f7e65891e1a8 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:26.962022 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-ab07f99f-55be-4504-acfd-f7e65891e1a8 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:27.090649 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-ab07f99f-55be-4504-acfd-f7e65891e1a8 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:27.099172 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-ab07f99f-55be-4504-acfd-f7e65891e1a8 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:27.100661 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-ab07f99f-55be-4504-acfd-f7e65891e1a8 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:27.101805 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-ab07f99f-55be-4504-acfd-f7e65891e1a8 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1805 microversion: 2.20 time: 0.152041 Jun 23 11:50:27.102400 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 353/670] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:50:26 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1805 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:50:27.602571 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-e25b2785-3381-4827-b174-8499d3a9ba11 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:27.603165 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-e25b2785-3381-4827-b174-8499d3a9ba11 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 6b648e87-b71a-4ef3-aada-f884b8efb154] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:27.609246 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-e25b2785-3381-4827-b174-8499d3a9ba11 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:27.609702 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-e25b2785-3381-4827-b174-8499d3a9ba11 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:27.610463 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-e25b2785-3381-4827-b174-8499d3a9ba11 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:27.610927 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-e25b2785-3381-4827-b174-8499d3a9ba11 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:27.737617 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-e25b2785-3381-4827-b174-8499d3a9ba11 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:27.746762 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-e25b2785-3381-4827-b174-8499d3a9ba11 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154" status: 200 len: 1722 microversion: 2.1 time: 0.147967 Jun 23 11:50:27.747292 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 318/671] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:50:27 2022] GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154 => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:50:27.831695 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-e2df46f3-c4f4-460c-9d4f-ed2cf670a327 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:27.832308 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-e2df46f3-c4f4-460c-9d4f-ed2cf670a327 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] [instance: c026366c-311a-45eb-899c-30703cd7eb1d] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:27.838685 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-e2df46f3-c4f4-460c-9d4f-ed2cf670a327 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:27.839137 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-e2df46f3-c4f4-460c-9d4f-ed2cf670a327 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:27.839892 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-e2df46f3-c4f4-460c-9d4f-ed2cf670a327 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:27.840326 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-e2df46f3-c4f4-460c-9d4f-ed2cf670a327 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:27.971325 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-e2df46f3-c4f4-460c-9d4f-ed2cf670a327 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626c3dbdc0f1407db82d6988e68e40b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce01d9a78d3f4bb7b101b47548b73037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:27.980099 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-e2df46f3-c4f4-460c-9d4f-ed2cf670a327 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] 10.222.0.13 "GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d" status: 200 len: 1568 microversion: 2.1 time: 0.152184 Jun 23 11:50:27.980865 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 354/672] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:50:27 2022] GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:50:28.121166 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-0f8484ff-6f9c-4ab5-a993-ee8dab434ec4 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:28.121774 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-0f8484ff-6f9c-4ab5-a993-ee8dab434ec4 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:28.127709 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-0f8484ff-6f9c-4ab5-a993-ee8dab434ec4 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:28.128153 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-0f8484ff-6f9c-4ab5-a993-ee8dab434ec4 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:28.131022 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-0f8484ff-6f9c-4ab5-a993-ee8dab434ec4 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:28.131022 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-0f8484ff-6f9c-4ab5-a993-ee8dab434ec4 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:28.214304 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [req-f7b6a42a-2c98-425d-8ac1-15761735ddab req-8712cce9-1654-4bcd-8b80-40826068f24f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9e98590-5036-4ade-bbba-f743256ac961", "name": "network-vif-plugged", "status": "completed", "tag": "ff54d5bf-cdc7-493b-be07-f5ca28b2681b"}]} {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:50:28.222924 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [req-f7b6a42a-2c98-425d-8ac1-15761735ddab req-8712cce9-1654-4bcd-8b80-40826068f24f service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:28.223284 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [req-f7b6a42a-2c98-425d-8ac1-15761735ddab req-8712cce9-1654-4bcd-8b80-40826068f24f service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:28.235498 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.compute.server_external_events [req-f7b6a42a-2c98-425d-8ac1-15761735ddab req-8712cce9-1654-4bcd-8b80-40826068f24f service nova] Creating event network-vif-plugged:ff54d5bf-cdc7-493b-be07-f5ca28b2681b for instance d9e98590-5036-4ade-bbba-f743256ac961 on hv-cinder-82099 Jun 23 11:50:28.240587 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [req-f7b6a42a-2c98-425d-8ac1-15761735ddab req-8712cce9-1654-4bcd-8b80-40826068f24f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158453 Jun 23 11:50:28.241177 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 319/673] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:50:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:50:28.272657 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-0f8484ff-6f9c-4ab5-a993-ee8dab434ec4 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:28.281464 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-0f8484ff-6f9c-4ab5-a993-ee8dab434ec4 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:28.282991 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-0f8484ff-6f9c-4ab5-a993-ee8dab434ec4 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:28.284141 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-0f8484ff-6f9c-4ab5-a993-ee8dab434ec4 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1805 microversion: 2.20 time: 0.167459 Jun 23 11:50:28.284691 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 355/674] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:50:28 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1805 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:50:28.764928 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-8617e9d3-cd45-4456-89ec-edcae1f7a772 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:28.765550 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-8617e9d3-cd45-4456-89ec-edcae1f7a772 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 6b648e87-b71a-4ef3-aada-f884b8efb154] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:28.771772 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-8617e9d3-cd45-4456-89ec-edcae1f7a772 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:28.772216 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-8617e9d3-cd45-4456-89ec-edcae1f7a772 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:28.772966 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-8617e9d3-cd45-4456-89ec-edcae1f7a772 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:28.773397 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-8617e9d3-cd45-4456-89ec-edcae1f7a772 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:28.901579 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-8617e9d3-cd45-4456-89ec-edcae1f7a772 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:28.909466 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-8617e9d3-cd45-4456-89ec-edcae1f7a772 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154" status: 200 len: 1728 microversion: 2.1 time: 0.148834 Jun 23 11:50:28.910024 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 320/675] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:50:28 2022] GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154 => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:50:28.926596 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-aee7b071-767c-4b58-a2de-0a7a93650bf5 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:28.927144 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-aee7b071-767c-4b58-a2de-0a7a93650bf5 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 6b648e87-b71a-4ef3-aada-f884b8efb154] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:28.933873 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-aee7b071-767c-4b58-a2de-0a7a93650bf5 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:28.934326 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-aee7b071-767c-4b58-a2de-0a7a93650bf5 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:28.935117 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-aee7b071-767c-4b58-a2de-0a7a93650bf5 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:28.935560 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-aee7b071-767c-4b58-a2de-0a7a93650bf5 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:28.997776 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-17a6e929-8d79-4edc-b87d-3f9db9895302 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:28.998441 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-17a6e929-8d79-4edc-b87d-3f9db9895302 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] [instance: c026366c-311a-45eb-899c-30703cd7eb1d] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:29.004461 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-17a6e929-8d79-4edc-b87d-3f9db9895302 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:29.004914 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-17a6e929-8d79-4edc-b87d-3f9db9895302 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:29.005681 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-17a6e929-8d79-4edc-b87d-3f9db9895302 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:29.006138 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-17a6e929-8d79-4edc-b87d-3f9db9895302 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:29.011436 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-aee7b071-767c-4b58-a2de-0a7a93650bf5 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088764 Jun 23 11:50:29.012021 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 356/676] 10.222.0.13 () {58 vars in 1274 bytes} [Thu Jun 23 11:50:28 2022] GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:50:29.148153 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-17a6e929-8d79-4edc-b87d-3f9db9895302 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626c3dbdc0f1407db82d6988e68e40b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce01d9a78d3f4bb7b101b47548b73037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:29.156013 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-17a6e929-8d79-4edc-b87d-3f9db9895302 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] 10.222.0.13 "GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d" status: 200 len: 1568 microversion: 2.1 time: 0.162904 Jun 23 11:50:29.156578 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 321/677] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:50:28 2022] GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:50:29.302628 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-812de1df-4913-4cd8-9bd5-5cbbf833f1a6 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:29.303293 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-812de1df-4913-4cd8-9bd5-5cbbf833f1a6 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:29.309936 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-812de1df-4913-4cd8-9bd5-5cbbf833f1a6 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:29.313754 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-812de1df-4913-4cd8-9bd5-5cbbf833f1a6 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:29.313754 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-812de1df-4913-4cd8-9bd5-5cbbf833f1a6 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:29.313754 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-812de1df-4913-4cd8-9bd5-5cbbf833f1a6 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:29.439270 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-812de1df-4913-4cd8-9bd5-5cbbf833f1a6 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:29.448469 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-812de1df-4913-4cd8-9bd5-5cbbf833f1a6 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:29.449968 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-812de1df-4913-4cd8-9bd5-5cbbf833f1a6 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:29.451161 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-812de1df-4913-4cd8-9bd5-5cbbf833f1a6 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1805 microversion: 2.20 time: 0.152496 Jun 23 11:50:29.452073 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 357/678] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:50:29 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1805 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:50:30.072750 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [req-d614b6ad-0128-49d1-bf9c-9cafaea6e79b req-e49acd1b-ad95-4114-a64b-b40bda51f65e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b648e87-b71a-4ef3-aada-f884b8efb154", "tag": "cae1bf17-0db1-4c4a-8280-5a78b15781a7"}]} {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:50:30.081075 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [req-d614b6ad-0128-49d1-bf9c-9cafaea6e79b req-e49acd1b-ad95-4114-a64b-b40bda51f65e service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:30.081527 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [req-d614b6ad-0128-49d1-bf9c-9cafaea6e79b req-e49acd1b-ad95-4114-a64b-b40bda51f65e service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:30.094235 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.compute.server_external_events [req-d614b6ad-0128-49d1-bf9c-9cafaea6e79b req-e49acd1b-ad95-4114-a64b-b40bda51f65e service nova] Creating event network-changed:cae1bf17-0db1-4c4a-8280-5a78b15781a7 for instance 6b648e87-b71a-4ef3-aada-f884b8efb154 on hv-cinder-82099 Jun 23 11:50:30.099254 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [req-d614b6ad-0128-49d1-bf9c-9cafaea6e79b req-e49acd1b-ad95-4114-a64b-b40bda51f65e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089156 Jun 23 11:50:30.099901 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 322/679] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:50:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:50:30.173325 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-99f905a4-6710-4233-848e-ac668fc5b0cc tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:30.174037 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-99f905a4-6710-4233-848e-ac668fc5b0cc tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] [instance: c026366c-311a-45eb-899c-30703cd7eb1d] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:30.180525 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-99f905a4-6710-4233-848e-ac668fc5b0cc tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:30.181631 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-99f905a4-6710-4233-848e-ac668fc5b0cc tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:30.181887 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-99f905a4-6710-4233-848e-ac668fc5b0cc tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:30.182316 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-99f905a4-6710-4233-848e-ac668fc5b0cc tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:30.318246 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-99f905a4-6710-4233-848e-ac668fc5b0cc tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626c3dbdc0f1407db82d6988e68e40b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce01d9a78d3f4bb7b101b47548b73037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:30.326468 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-99f905a4-6710-4233-848e-ac668fc5b0cc tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] 10.222.0.13 "GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d" status: 200 len: 1568 microversion: 2.1 time: 0.157173 Jun 23 11:50:30.327238 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 358/680] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:50:30 2022] GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:50:30.470683 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-5605d1ff-0c71-487d-b758-7481c3190423 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:30.471474 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-5605d1ff-0c71-487d-b758-7481c3190423 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:30.478371 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-5605d1ff-0c71-487d-b758-7481c3190423 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:30.478914 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-5605d1ff-0c71-487d-b758-7481c3190423 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:30.479678 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-5605d1ff-0c71-487d-b758-7481c3190423 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:30.480111 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-5605d1ff-0c71-487d-b758-7481c3190423 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:30.611124 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-5605d1ff-0c71-487d-b758-7481c3190423 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:30.620163 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-5605d1ff-0c71-487d-b758-7481c3190423 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:30.621685 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-5605d1ff-0c71-487d-b758-7481c3190423 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:30.623197 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-5605d1ff-0c71-487d-b758-7481c3190423 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1805 microversion: 2.20 time: 0.156705 Jun 23 11:50:30.633338 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 323/681] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:50:30 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1805 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:50:31.344398 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-a58b16b0-bab2-49c9-8517-15704d762db8 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:31.344934 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-a58b16b0-bab2-49c9-8517-15704d762db8 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] [instance: c026366c-311a-45eb-899c-30703cd7eb1d] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:31.351097 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a58b16b0-bab2-49c9-8517-15704d762db8 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:31.351537 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a58b16b0-bab2-49c9-8517-15704d762db8 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:31.352969 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a58b16b0-bab2-49c9-8517-15704d762db8 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:31.353447 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a58b16b0-bab2-49c9-8517-15704d762db8 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:31.489792 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-a58b16b0-bab2-49c9-8517-15704d762db8 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626c3dbdc0f1407db82d6988e68e40b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce01d9a78d3f4bb7b101b47548b73037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:31.493477 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-a58b16b0-bab2-49c9-8517-15704d762db8 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] 10.222.0.13 "GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d" status: 200 len: 1568 microversion: 2.1 time: 0.153408 Jun 23 11:50:31.494084 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 359/682] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:50:31 2022] GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:50:31.640928 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-291e4ec4-e3c1-4990-aad1-c74cdd2621be tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:31.641507 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-291e4ec4-e3c1-4990-aad1-c74cdd2621be tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:31.648319 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-291e4ec4-e3c1-4990-aad1-c74cdd2621be tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:31.648773 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-291e4ec4-e3c1-4990-aad1-c74cdd2621be tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:31.649580 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-291e4ec4-e3c1-4990-aad1-c74cdd2621be tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:31.650211 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-291e4ec4-e3c1-4990-aad1-c74cdd2621be tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:31.786065 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-291e4ec4-e3c1-4990-aad1-c74cdd2621be tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:31.795345 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-291e4ec4-e3c1-4990-aad1-c74cdd2621be tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:31.796935 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-291e4ec4-e3c1-4990-aad1-c74cdd2621be tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:31.798142 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-291e4ec4-e3c1-4990-aad1-c74cdd2621be tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1805 microversion: 2.20 time: 0.161116 Jun 23 11:50:31.807160 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 324/683] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:50:31 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1805 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:50:32.129906 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [req-40c1fdf4-4900-49a0-a10d-9363e636b15b req-b7a237d4-2cfb-4efd-b48c-f1ff12553948 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b648e87-b71a-4ef3-aada-f884b8efb154", "tag": "cae1bf17-0db1-4c4a-8280-5a78b15781a7"}]} {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:50:32.138670 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-40c1fdf4-4900-49a0-a10d-9363e636b15b req-b7a237d4-2cfb-4efd-b48c-f1ff12553948 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:32.139330 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-40c1fdf4-4900-49a0-a10d-9363e636b15b req-b7a237d4-2cfb-4efd-b48c-f1ff12553948 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:32.152557 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.compute.server_external_events [req-40c1fdf4-4900-49a0-a10d-9363e636b15b req-b7a237d4-2cfb-4efd-b48c-f1ff12553948 service nova] Creating event network-changed:cae1bf17-0db1-4c4a-8280-5a78b15781a7 for instance 6b648e87-b71a-4ef3-aada-f884b8efb154 on hv-cinder-82099 Jun 23 11:50:32.157877 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [req-40c1fdf4-4900-49a0-a10d-9363e636b15b req-b7a237d4-2cfb-4efd-b48c-f1ff12553948 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031478 Jun 23 11:50:32.158701 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 360/684] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:50:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:50:32.511823 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-1c3693c4-b94c-4d02-b018-e1e7c38643ab tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:32.512438 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-1c3693c4-b94c-4d02-b018-e1e7c38643ab tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] [instance: c026366c-311a-45eb-899c-30703cd7eb1d] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:32.518561 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-1c3693c4-b94c-4d02-b018-e1e7c38643ab tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:32.519038 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-1c3693c4-b94c-4d02-b018-e1e7c38643ab tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:32.519802 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-1c3693c4-b94c-4d02-b018-e1e7c38643ab tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:32.520242 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-1c3693c4-b94c-4d02-b018-e1e7c38643ab tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:32.647196 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-1c3693c4-b94c-4d02-b018-e1e7c38643ab tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626c3dbdc0f1407db82d6988e68e40b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce01d9a78d3f4bb7b101b47548b73037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:32.654753 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-1c3693c4-b94c-4d02-b018-e1e7c38643ab tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] 10.222.0.13 "GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d" status: 200 len: 1568 microversion: 2.1 time: 0.147390 Jun 23 11:50:32.657232 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 325/685] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:50:32 2022] GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:50:32.817231 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-82f5830b-59f8-4b9a-adfa-e0997dd877f0 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:32.817851 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-82f5830b-59f8-4b9a-adfa-e0997dd877f0 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:32.824614 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-82f5830b-59f8-4b9a-adfa-e0997dd877f0 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:32.825065 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-82f5830b-59f8-4b9a-adfa-e0997dd877f0 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:32.825814 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-82f5830b-59f8-4b9a-adfa-e0997dd877f0 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:32.826248 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-82f5830b-59f8-4b9a-adfa-e0997dd877f0 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:32.956559 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-82f5830b-59f8-4b9a-adfa-e0997dd877f0 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:32.965033 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-82f5830b-59f8-4b9a-adfa-e0997dd877f0 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:32.966508 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-82f5830b-59f8-4b9a-adfa-e0997dd877f0 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:32.967668 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-82f5830b-59f8-4b9a-adfa-e0997dd877f0 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1805 microversion: 2.20 time: 0.154770 Jun 23 11:50:32.968222 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 361/686] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:50:32 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1805 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:50:33.673101 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-27540267-4997-40e8-a86f-e4910dfc135e tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:33.673737 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-27540267-4997-40e8-a86f-e4910dfc135e tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] [instance: c026366c-311a-45eb-899c-30703cd7eb1d] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:33.680707 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-27540267-4997-40e8-a86f-e4910dfc135e tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:33.681236 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-27540267-4997-40e8-a86f-e4910dfc135e tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:33.682002 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-27540267-4997-40e8-a86f-e4910dfc135e tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:33.682438 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-27540267-4997-40e8-a86f-e4910dfc135e tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:33.815030 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-27540267-4997-40e8-a86f-e4910dfc135e tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626c3dbdc0f1407db82d6988e68e40b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce01d9a78d3f4bb7b101b47548b73037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:33.824789 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-27540267-4997-40e8-a86f-e4910dfc135e tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] 10.222.0.13 "GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d" status: 200 len: 1568 microversion: 2.1 time: 0.155519 Jun 23 11:50:33.825564 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 326/687] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:50:33 2022] GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:50:33.985205 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-02cfa11b-7bfa-4454-b207-76a48894aa15 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:33.985818 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-02cfa11b-7bfa-4454-b207-76a48894aa15 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:33.992017 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-02cfa11b-7bfa-4454-b207-76a48894aa15 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:33.992469 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-02cfa11b-7bfa-4454-b207-76a48894aa15 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:33.993342 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-02cfa11b-7bfa-4454-b207-76a48894aa15 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:33.993781 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-02cfa11b-7bfa-4454-b207-76a48894aa15 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:34.131382 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-02cfa11b-7bfa-4454-b207-76a48894aa15 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:34.140977 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-02cfa11b-7bfa-4454-b207-76a48894aa15 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:34.143696 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-02cfa11b-7bfa-4454-b207-76a48894aa15 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:34.145136 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-02cfa11b-7bfa-4454-b207-76a48894aa15 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1792 microversion: 2.20 time: 0.163864 Jun 23 11:50:34.145693 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 362/688] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:50:33 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1792 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:50:34.268908 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-7601e491-7532-4450-bb87-7c879515d758 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:34.269401 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-7601e491-7532-4450-bb87-7c879515d758 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:34.275861 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-7601e491-7532-4450-bb87-7c879515d758 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:34.276310 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-7601e491-7532-4450-bb87-7c879515d758 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:34.277201 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-7601e491-7532-4450-bb87-7c879515d758 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:34.277639 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-7601e491-7532-4450-bb87-7c879515d758 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:34.361621 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.objects.instance [None req-7601e491-7532-4450-bb87-7c879515d758 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lazy-loading 'services' on Instance uuid 46d9d467-7a71-4e30-af82-629121319200 {{(pid=124669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:50:34.627239 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-7601e491-7532-4450-bb87-7c879515d758 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "DELETE /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200/os-volume_attachments/f0c792e1-91a2-45a7-83a6-dceabd9d79e0" status: 202 len: 0 microversion: 2.1 time: 0.462214 Jun 23 11:50:34.627890 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 327/689] 10.222.0.13 () {58 vars in 1415 bytes} [Thu Jun 23 11:50:34 2022] DELETE /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200/os-volume_attachments/f0c792e1-91a2-45a7-83a6-dceabd9d79e0 => generated 0 bytes in 464 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 11:50:34.843097 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-4ca1410a-a11a-4db0-a9e0-769ecde97876 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:34.844163 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-4ca1410a-a11a-4db0-a9e0-769ecde97876 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] [instance: c026366c-311a-45eb-899c-30703cd7eb1d] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:34.850273 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-4ca1410a-a11a-4db0-a9e0-769ecde97876 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:34.850766 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-4ca1410a-a11a-4db0-a9e0-769ecde97876 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:34.851549 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-4ca1410a-a11a-4db0-a9e0-769ecde97876 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:34.852010 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-4ca1410a-a11a-4db0-a9e0-769ecde97876 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:34.982787 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-4ca1410a-a11a-4db0-a9e0-769ecde97876 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626c3dbdc0f1407db82d6988e68e40b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce01d9a78d3f4bb7b101b47548b73037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:34.990250 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-4ca1410a-a11a-4db0-a9e0-769ecde97876 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] 10.222.0.13 "GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d" status: 200 len: 1568 microversion: 2.1 time: 0.151083 Jun 23 11:50:34.990855 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 363/690] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:50:34 2022] GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:50:36.013089 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-58c16894-6a01-4b34-a8cc-8df10b585e76 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:36.013767 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-58c16894-6a01-4b34-a8cc-8df10b585e76 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] [instance: c026366c-311a-45eb-899c-30703cd7eb1d] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:36.020191 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-58c16894-6a01-4b34-a8cc-8df10b585e76 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:36.026393 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-58c16894-6a01-4b34-a8cc-8df10b585e76 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:36.026393 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-58c16894-6a01-4b34-a8cc-8df10b585e76 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:36.026393 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-58c16894-6a01-4b34-a8cc-8df10b585e76 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:36.157190 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-58c16894-6a01-4b34-a8cc-8df10b585e76 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626c3dbdc0f1407db82d6988e68e40b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce01d9a78d3f4bb7b101b47548b73037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:36.164854 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-58c16894-6a01-4b34-a8cc-8df10b585e76 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] 10.222.0.13 "GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d" status: 200 len: 1509 microversion: 2.1 time: 0.157784 Jun 23 11:50:36.165452 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 328/691] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:50:36 2022] GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d => generated 1509 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:50:36.181653 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-80e560c3-003a-4b77-a902-9e383f026371 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:50:36.182263 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-80e560c3-003a-4b77-a902-9e383f026371 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] [instance: c026366c-311a-45eb-899c-30703cd7eb1d] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:36.188346 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-80e560c3-003a-4b77-a902-9e383f026371 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:36.188794 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-80e560c3-003a-4b77-a902-9e383f026371 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:36.189625 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-80e560c3-003a-4b77-a902-9e383f026371 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:36.190054 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-80e560c3-003a-4b77-a902-9e383f026371 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:36.383502 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-80e560c3-003a-4b77-a902-9e383f026371 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] 10.222.0.13 "POST /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d/action" status: 202 len: 0 microversion: 2.1 time: 0.205906 Jun 23 11:50:36.384745 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 364/692] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Jun 23 11:50:36 2022] POST /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d/action => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 11:50:36.393393 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-5f54132f-6f26-4a92-a34f-7740066c6bdd tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:36.394101 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-5f54132f-6f26-4a92-a34f-7740066c6bdd tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] [instance: c026366c-311a-45eb-899c-30703cd7eb1d] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:36.400720 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-5f54132f-6f26-4a92-a34f-7740066c6bdd tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:36.401174 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-5f54132f-6f26-4a92-a34f-7740066c6bdd tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:36.401956 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-5f54132f-6f26-4a92-a34f-7740066c6bdd tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:36.402396 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-5f54132f-6f26-4a92-a34f-7740066c6bdd tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:36.406731 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:50:36.537673 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-5f54132f-6f26-4a92-a34f-7740066c6bdd tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626c3dbdc0f1407db82d6988e68e40b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce01d9a78d3f4bb7b101b47548b73037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:36.546096 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-5f54132f-6f26-4a92-a34f-7740066c6bdd tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] 10.222.0.13 "GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d" status: 200 len: 1517 microversion: 2.1 time: 0.156476 Jun 23 11:50:36.547094 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 329/693] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:50:36 2022] GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d => generated 1517 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:50:36.796206 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-b6a8ea8a-4480-43b9-bca3-4eeb948c8865 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:50:36.802188 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-b6a8ea8a-4480-43b9-bca3-4eeb948c8865 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:36.802662 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-b6a8ea8a-4480-43b9-bca3-4eeb948c8865 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:36.863597 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-b6a8ea8a-4480-43b9-bca3-4eeb948c8865 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Going to try to stop instance {{(pid=124670) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 23 11:50:37.077027 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-b6a8ea8a-4480-43b9-bca3-4eeb948c8865 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "POST /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200/action" status: 202 len: 0 microversion: 2.1 time: 0.284491 Jun 23 11:50:37.077719 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 365/694] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Jun 23 11:50:36 2022] POST /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200/action => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 11:50:37.085701 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-60de06d9-1fd1-4839-bb2f-7c4baa4b4d16 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:37.086317 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-60de06d9-1fd1-4839-bb2f-7c4baa4b4d16 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:37.093070 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-60de06d9-1fd1-4839-bb2f-7c4baa4b4d16 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:37.093554 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-60de06d9-1fd1-4839-bb2f-7c4baa4b4d16 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:37.094599 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-60de06d9-1fd1-4839-bb2f-7c4baa4b4d16 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:37.095038 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-60de06d9-1fd1-4839-bb2f-7c4baa4b4d16 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:37.225472 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-60de06d9-1fd1-4839-bb2f-7c4baa4b4d16 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:37.233865 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-60de06d9-1fd1-4839-bb2f-7c4baa4b4d16 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 200 len: 1680 microversion: 2.1 time: 0.151950 Jun 23 11:50:37.234429 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 330/695] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:50:37 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:50:37.563419 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-64f5376e-2f2e-4918-a37d-ccc7f00b3d3a tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:37.564112 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-64f5376e-2f2e-4918-a37d-ccc7f00b3d3a tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] [instance: c026366c-311a-45eb-899c-30703cd7eb1d] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:37.570210 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-64f5376e-2f2e-4918-a37d-ccc7f00b3d3a tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:37.570688 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-64f5376e-2f2e-4918-a37d-ccc7f00b3d3a tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:37.571443 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-64f5376e-2f2e-4918-a37d-ccc7f00b3d3a tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:37.572369 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-64f5376e-2f2e-4918-a37d-ccc7f00b3d3a tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:37.714328 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-64f5376e-2f2e-4918-a37d-ccc7f00b3d3a tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626c3dbdc0f1407db82d6988e68e40b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce01d9a78d3f4bb7b101b47548b73037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:37.717795 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:50:37.722463 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-64f5376e-2f2e-4918-a37d-ccc7f00b3d3a tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] 10.222.0.13 "GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d" status: 200 len: 1517 microversion: 2.1 time: 0.163265 Jun 23 11:50:37.722956 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 366/696] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:50:37 2022] GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d => generated 1517 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:50:38.086991 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [req-ba5fe42f-fefd-4f3b-a2da-56c565a8b3d9 req-81d9b1b5-c4fc-4ada-a5b4-a69401414c38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c026366c-311a-45eb-899c-30703cd7eb1d", "name": "network-vif-unplugged", "status": "completed", "tag": "0d774b3d-b1c7-415f-9da5-0abe6a54a4eb"}]} {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:50:38.096046 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [req-ba5fe42f-fefd-4f3b-a2da-56c565a8b3d9 req-81d9b1b5-c4fc-4ada-a5b4-a69401414c38 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:38.096559 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [req-ba5fe42f-fefd-4f3b-a2da-56c565a8b3d9 req-81d9b1b5-c4fc-4ada-a5b4-a69401414c38 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:38.107890 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.compute.server_external_events [req-ba5fe42f-fefd-4f3b-a2da-56c565a8b3d9 req-81d9b1b5-c4fc-4ada-a5b4-a69401414c38 service nova] Unable to find a host for instance c026366c-311a-45eb-899c-30703cd7eb1d. Dropping event network-vif-unplugged {{(pid=124669) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 23 11:50:38.108775 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [req-ba5fe42f-fefd-4f3b-a2da-56c565a8b3d9 req-81d9b1b5-c4fc-4ada-a5b4-a69401414c38 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.025663 Jun 23 11:50:38.109354 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 331/697] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:50:38 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 27 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 23 11:50:38.251127 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-f3b3ed22-e3ac-44d8-a658-cd5a706b0d98 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:38.251666 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-f3b3ed22-e3ac-44d8-a658-cd5a706b0d98 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:38.258001 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-f3b3ed22-e3ac-44d8-a658-cd5a706b0d98 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:38.258445 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-f3b3ed22-e3ac-44d8-a658-cd5a706b0d98 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:38.274457 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-f3b3ed22-e3ac-44d8-a658-cd5a706b0d98 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:38.274457 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-f3b3ed22-e3ac-44d8-a658-cd5a706b0d98 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:38.388612 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-f3b3ed22-e3ac-44d8-a658-cd5a706b0d98 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:38.396035 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-f3b3ed22-e3ac-44d8-a658-cd5a706b0d98 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 200 len: 1680 microversion: 2.1 time: 0.149185 Jun 23 11:50:38.396587 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 367/698] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:50:38 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 1680 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:50:38.740197 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-04b6b3b7-f4cb-4d62-a42e-34fe3ac66bbb tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:38.740807 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-04b6b3b7-f4cb-4d62-a42e-34fe3ac66bbb tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] [instance: c026366c-311a-45eb-899c-30703cd7eb1d] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:38.746972 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-04b6b3b7-f4cb-4d62-a42e-34fe3ac66bbb tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:38.747417 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-04b6b3b7-f4cb-4d62-a42e-34fe3ac66bbb tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:38.748174 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-04b6b3b7-f4cb-4d62-a42e-34fe3ac66bbb tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:38.748649 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-04b6b3b7-f4cb-4d62-a42e-34fe3ac66bbb tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:38.887329 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-04b6b3b7-f4cb-4d62-a42e-34fe3ac66bbb tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626c3dbdc0f1407db82d6988e68e40b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce01d9a78d3f4bb7b101b47548b73037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:38.894825 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-04b6b3b7-f4cb-4d62-a42e-34fe3ac66bbb tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] 10.222.0.13 "GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d" status: 200 len: 1519 microversion: 2.1 time: 0.158576 Jun 23 11:50:38.895386 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 332/699] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:50:38 2022] GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:50:39.413218 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-a6650e2a-6400-4591-a9f8-3041ea82fac2 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:39.413871 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-a6650e2a-6400-4591-a9f8-3041ea82fac2 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:39.419984 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a6650e2a-6400-4591-a9f8-3041ea82fac2 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:39.420428 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a6650e2a-6400-4591-a9f8-3041ea82fac2 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:39.421177 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a6650e2a-6400-4591-a9f8-3041ea82fac2 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:39.421608 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a6650e2a-6400-4591-a9f8-3041ea82fac2 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:39.792692 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-a6650e2a-6400-4591-a9f8-3041ea82fac2 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:39.800040 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-a6650e2a-6400-4591-a9f8-3041ea82fac2 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 200 len: 1680 microversion: 2.1 time: 0.390694 Jun 23 11:50:39.800598 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 368/700] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:50:39 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 1680 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:50:39.913296 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-639e6bf3-dbb4-49e4-80ba-85947a265527 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:39.913893 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-639e6bf3-dbb4-49e4-80ba-85947a265527 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] [instance: c026366c-311a-45eb-899c-30703cd7eb1d] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:39.921264 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-639e6bf3-dbb4-49e4-80ba-85947a265527 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:39.921713 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-639e6bf3-dbb4-49e4-80ba-85947a265527 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:39.922481 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-639e6bf3-dbb4-49e4-80ba-85947a265527 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:39.922934 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-639e6bf3-dbb4-49e4-80ba-85947a265527 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:40.060229 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-639e6bf3-dbb4-49e4-80ba-85947a265527 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626c3dbdc0f1407db82d6988e68e40b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce01d9a78d3f4bb7b101b47548b73037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:40.067975 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-639e6bf3-dbb4-49e4-80ba-85947a265527 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] 10.222.0.13 "GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d" status: 200 len: 1575 microversion: 2.1 time: 0.158560 Jun 23 11:50:40.068547 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 333/701] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:50:39 2022] GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:50:40.817398 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-a0b55f46-ae1b-4497-93b1-ff197ad6d81e tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:40.818007 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-a0b55f46-ae1b-4497-93b1-ff197ad6d81e tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:40.823982 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a0b55f46-ae1b-4497-93b1-ff197ad6d81e tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:40.824425 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a0b55f46-ae1b-4497-93b1-ff197ad6d81e tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:40.825174 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a0b55f46-ae1b-4497-93b1-ff197ad6d81e tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:40.825607 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a0b55f46-ae1b-4497-93b1-ff197ad6d81e tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:40.952041 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-a0b55f46-ae1b-4497-93b1-ff197ad6d81e tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:40.959443 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-a0b55f46-ae1b-4497-93b1-ff197ad6d81e tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 200 len: 1680 microversion: 2.1 time: 0.145894 Jun 23 11:50:40.959993 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 369/702] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:50:40 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 1680 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:50:41.085005 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-1d4925d3-0896-4205-b457-9f2c9cfe204a tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:41.085626 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-1d4925d3-0896-4205-b457-9f2c9cfe204a tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] [instance: c026366c-311a-45eb-899c-30703cd7eb1d] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:41.092888 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-1d4925d3-0896-4205-b457-9f2c9cfe204a tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:41.093327 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-1d4925d3-0896-4205-b457-9f2c9cfe204a tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:41.094319 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-1d4925d3-0896-4205-b457-9f2c9cfe204a tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:41.094786 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-1d4925d3-0896-4205-b457-9f2c9cfe204a tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:41.222600 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-1d4925d3-0896-4205-b457-9f2c9cfe204a tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626c3dbdc0f1407db82d6988e68e40b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce01d9a78d3f4bb7b101b47548b73037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:41.230510 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-1d4925d3-0896-4205-b457-9f2c9cfe204a tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] 10.222.0.13 "GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d" status: 200 len: 1575 microversion: 2.1 time: 0.149438 Jun 23 11:50:41.231096 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 334/703] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:50:41 2022] GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:50:41.977207 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-c1738b44-9913-46e1-a5fd-f617ebdaf3ca tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:41.989335 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-c1738b44-9913-46e1-a5fd-f617ebdaf3ca tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:41.989335 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-c1738b44-9913-46e1-a5fd-f617ebdaf3ca tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:41.989335 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-c1738b44-9913-46e1-a5fd-f617ebdaf3ca tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:41.989335 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-c1738b44-9913-46e1-a5fd-f617ebdaf3ca tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:41.989708 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-c1738b44-9913-46e1-a5fd-f617ebdaf3ca tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:42.114226 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-c1738b44-9913-46e1-a5fd-f617ebdaf3ca tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:42.121790 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-c1738b44-9913-46e1-a5fd-f617ebdaf3ca tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 200 len: 1680 microversion: 2.1 time: 0.148422 Jun 23 11:50:42.122351 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 370/704] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:50:41 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 1680 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:50:42.247397 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-c825a330-fab7-4ede-83d5-12bc3f3e6a70 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:42.247911 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-c825a330-fab7-4ede-83d5-12bc3f3e6a70 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] [instance: c026366c-311a-45eb-899c-30703cd7eb1d] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:42.250205 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_api:SELECT=70 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:50:42.254941 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c825a330-fab7-4ede-83d5-12bc3f3e6a70 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:42.255388 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c825a330-fab7-4ede-83d5-12bc3f3e6a70 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:42.256141 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c825a330-fab7-4ede-83d5-12bc3f3e6a70 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:42.256576 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c825a330-fab7-4ede-83d5-12bc3f3e6a70 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:42.383936 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-c825a330-fab7-4ede-83d5-12bc3f3e6a70 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626c3dbdc0f1407db82d6988e68e40b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce01d9a78d3f4bb7b101b47548b73037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:42.392007 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-c825a330-fab7-4ede-83d5-12bc3f3e6a70 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] 10.222.0.13 "GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d" status: 200 len: 1575 microversion: 2.1 time: 0.148723 Jun 23 11:50:42.392571 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 335/705] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:50:42 2022] GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d => generated 1575 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:50:43.139399 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-cc6f33ae-e28c-4a60-846a-f21db695400a tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:43.140034 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-cc6f33ae-e28c-4a60-846a-f21db695400a tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:43.141870 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_api:SELECT=72 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:50:43.146514 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-cc6f33ae-e28c-4a60-846a-f21db695400a tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:43.146985 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-cc6f33ae-e28c-4a60-846a-f21db695400a tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:43.147726 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-cc6f33ae-e28c-4a60-846a-f21db695400a tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:43.148153 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-cc6f33ae-e28c-4a60-846a-f21db695400a tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:43.276909 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-cc6f33ae-e28c-4a60-846a-f21db695400a tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:43.284302 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-cc6f33ae-e28c-4a60-846a-f21db695400a tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 200 len: 1680 microversion: 2.1 time: 0.149525 Jun 23 11:50:43.284851 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 371/706] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:50:43 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:50:43.408757 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-e44e780b-837c-49c2-a177-10b96ab57e55 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:43.409294 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-e44e780b-837c-49c2-a177-10b96ab57e55 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] [instance: c026366c-311a-45eb-899c-30703cd7eb1d] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:43.415795 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-e44e780b-837c-49c2-a177-10b96ab57e55 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:43.416243 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-e44e780b-837c-49c2-a177-10b96ab57e55 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:43.417061 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-e44e780b-837c-49c2-a177-10b96ab57e55 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:43.417548 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-e44e780b-837c-49c2-a177-10b96ab57e55 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:43.545091 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-e44e780b-837c-49c2-a177-10b96ab57e55 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626c3dbdc0f1407db82d6988e68e40b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce01d9a78d3f4bb7b101b47548b73037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:43.552692 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-e44e780b-837c-49c2-a177-10b96ab57e55 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] 10.222.0.13 "GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d" status: 200 len: 1575 microversion: 2.1 time: 0.147864 Jun 23 11:50:43.553254 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 336/707] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:50:43 2022] GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d => generated 1575 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:50:44.301551 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-698f9dcd-8a8b-4f22-88af-63cb0fe9b29c tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:44.302152 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-698f9dcd-8a8b-4f22-88af-63cb0fe9b29c tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:44.308359 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-698f9dcd-8a8b-4f22-88af-63cb0fe9b29c tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:44.308796 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-698f9dcd-8a8b-4f22-88af-63cb0fe9b29c tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:44.309539 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-698f9dcd-8a8b-4f22-88af-63cb0fe9b29c tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:44.309968 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-698f9dcd-8a8b-4f22-88af-63cb0fe9b29c tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:44.436629 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-698f9dcd-8a8b-4f22-88af-63cb0fe9b29c tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:44.443964 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-698f9dcd-8a8b-4f22-88af-63cb0fe9b29c tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 200 len: 1680 microversion: 2.1 time: 0.146247 Jun 23 11:50:44.444514 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 372/708] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:50:44 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 1680 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:50:44.573368 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-a6b0ec28-767b-4c4a-b567-e2eefdce71d6 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:44.574429 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-a6b0ec28-767b-4c4a-b567-e2eefdce71d6 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] [instance: c026366c-311a-45eb-899c-30703cd7eb1d] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:44.582661 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-a6b0ec28-767b-4c4a-b567-e2eefdce71d6 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:44.583305 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-a6b0ec28-767b-4c4a-b567-e2eefdce71d6 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:44.584422 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-a6b0ec28-767b-4c4a-b567-e2eefdce71d6 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:44.584891 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-a6b0ec28-767b-4c4a-b567-e2eefdce71d6 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:44.725637 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-a6b0ec28-767b-4c4a-b567-e2eefdce71d6 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626c3dbdc0f1407db82d6988e68e40b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce01d9a78d3f4bb7b101b47548b73037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:44.733570 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-a6b0ec28-767b-4c4a-b567-e2eefdce71d6 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] 10.222.0.13 "GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d" status: 200 len: 1575 microversion: 2.1 time: 0.166881 Jun 23 11:50:44.734161 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 337/709] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:50:44 2022] GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d => generated 1575 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:50:45.348197 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-a168e245-6001-4701-8fa6-68cd3ab0f512 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:45.348685 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-a168e245-6001-4701-8fa6-68cd3ab0f512 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 76c7fe26-3425-4f59-8a7e-4281b4b6ed3f] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:45.355440 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a168e245-6001-4701-8fa6-68cd3ab0f512 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:45.356054 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a168e245-6001-4701-8fa6-68cd3ab0f512 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:45.356850 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a168e245-6001-4701-8fa6-68cd3ab0f512 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:45.357286 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a168e245-6001-4701-8fa6-68cd3ab0f512 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:45.380118 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-a168e245-6001-4701-8fa6-68cd3ab0f512 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/76c7fe26-3425-4f59-8a7e-4281b4b6ed3f/ips" status: 200 len: 149 microversion: 2.1 time: 0.139611 Jun 23 11:50:45.380663 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 373/710] 10.222.0.13 () {58 vars in 1247 bytes} [Thu Jun 23 11:50:45 2022] GET /compute/v2.1/servers/76c7fe26-3425-4f59-8a7e-4281b4b6ed3f/ips => generated 149 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:50:45.391591 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-6e947c91-df33-48ee-9d41-145f6cc32c3d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dd5302c9-15df-4e97-98eb-70965c9010f1"}} {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:50:45.392705 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-6e947c91-df33-48ee-9d41-145f6cc32c3d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 76c7fe26-3425-4f59-8a7e-4281b4b6ed3f] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:45.398667 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-6e947c91-df33-48ee-9d41-145f6cc32c3d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:45.399110 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-6e947c91-df33-48ee-9d41-145f6cc32c3d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:45.399856 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-6e947c91-df33-48ee-9d41-145f6cc32c3d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:45.400317 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-6e947c91-df33-48ee-9d41-145f6cc32c3d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:45.460898 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-d35f79e4-1c9d-44c6-ad93-61057b2e47b2 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:45.461506 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-d35f79e4-1c9d-44c6-ad93-61057b2e47b2 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:45.468078 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-d35f79e4-1c9d-44c6-ad93-61057b2e47b2 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:45.468528 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-d35f79e4-1c9d-44c6-ad93-61057b2e47b2 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:45.469538 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-d35f79e4-1c9d-44c6-ad93-61057b2e47b2 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:45.469982 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-d35f79e4-1c9d-44c6-ad93-61057b2e47b2 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:45.478883 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.wsgi [None req-6e947c91-df33-48ee-9d41-145f6cc32c3d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] HTTP exception thrown: Invalid volume: volume dd5302c9-15df-4e97-98eb-70965c9010f1 is already attached to instances: 250e2ce6-70ad-4082-8073-6a9cea0ca1e4 Jun 23 11:50:45.480982 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-6e947c91-df33-48ee-9d41-145f6cc32c3d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Request method failure captured: Jun 23 11:50:45.480982 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: request: POST /compute/v2.1/servers/76c7fe26-3425-4f59-8a7e-4281b4b6ed3f/os-volume_attachments HTTP/1.1 Jun 23 11:50:45.480982 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Accept: application/json Jun 23 11:50:45.480982 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Accept-Encoding: identity Jun 23 11:50:45.480982 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Connection: close Jun 23 11:50:45.480982 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Content-Length: 74 Jun 23 11:50:45.480982 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Content-Type: application/json Jun 23 11:50:45.480982 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Host: 10.222.0.13 Jun 23 11:50:45.480982 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Openstack-System-Scope: None Jun 23 11:50:45.480982 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: User-Agent: python-urllib3/1.26.9 Jun 23 11:50:45.480982 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Auth-Token: gAAAAABitFIKMke7vIBbvXT2RfPc-4frmGbwTZtMddIa6SPtgPblRzRqc8HMry6yk8WPdy-omEmS4IGKEBZ0krkMZ2AKKZ3XIi6QwXYCvuOyoif5_u-lfFNTFOpNeH9m810_qoSsO3823Vbqo3_NJM0PRtSxfQcTjP265INpx0gWYDOG-d8IrtY Jun 23 11:50:45.480982 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Domain-Id: None Jun 23 11:50:45.480982 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Domain-Name: None Jun 23 11:50:45.480982 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Identity-Status: Confirmed Jun 23 11:50:45.480982 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Is-Admin-Project: True Jun 23 11:50:45.480982 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Domain-Id: default Jun 23 11:50:45.480982 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Domain-Name: Default Jun 23 11:50:45.480982 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Id: ee135767dfc846469d64b658372994a8 Jun 23 11:50:45.480982 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Name: tempest-AttachVolumeNegativeTest-213077295 Jun 23 11:50:45.480982 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Role: member,reader Jun 23 11:50:45.480982 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Roles: member,reader Jun 23 11:50:45.482357 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ee135767dfc846469d64b658372994a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ee135767dfc846469d64b658372994a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ee135767dfc846469d64b658372994a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ee135767dfc846469d64b658372994a8"}]}] Jun 23 11:50:45.482357 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant: tempest-AttachVolumeNegativeTest-213077295 Jun 23 11:50:45.482357 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant-Id: ee135767dfc846469d64b658372994a8 Jun 23 11:50:45.482357 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-213077295 Jun 23 11:50:45.482357 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User: tempest-AttachVolumeNegativeTest-213077295-project Jun 23 11:50:45.482357 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Domain-Id: default Jun 23 11:50:45.482357 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Domain-Name: Default Jun 23 11:50:45.482357 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Id: b7fd8323d29d445f903e2103453e8ae6 Jun 23 11:50:45.482357 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Name: tempest-AttachVolumeNegativeTest-213077295-project Jun 23 11:50:45.482357 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Jun 23 11:50:45.482357 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: {"volumeAttachment": {"volumeId": "dd5302c9-15df-4e97-98eb-70965c9010f1"}} Jun 23 11:50:45.482357 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: method: > Jun 23 11:50:45.483696 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: exception: Invalid volume: volume dd5302c9-15df-4e97-98eb-70965c9010f1 is already attached to instances: 250e2ce6-70ad-4082-8073-6a9cea0ca1e4 Jun 23 11:50:45.483696 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: action_args: {'server_id': '76c7fe26-3425-4f59-8a7e-4281b4b6ed3f', 'body': {'volumeAttachment': {'volumeId': 'dd5302c9-15df-4e97-98eb-70965c9010f1'}}} Jun 23 11:50:45.483696 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:50:45.483696 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:50:45.483696 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 23 11:50:45.483696 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 23 11:50:45.483696 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 23 11:50:45.483696 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 23 11:50:45.483696 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 23 11:50:45.483696 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 23 11:50:45.483696 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 23 11:50:45.483696 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 23 11:50:45.483696 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 23 11:50:45.483696 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 23 11:50:45.483696 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume dd5302c9-15df-4e97-98eb-70965c9010f1 is already attached to instances: 250e2ce6-70ad-4082-8073-6a9cea0ca1e4 Jun 23 11:50:45.483696 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:50:45.483696 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:50:45.483696 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:50:45.483696 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:50:45.484981 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:50:45.484981 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:50:45.484981 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:50:45.484981 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:50:45.484981 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:50:45.484981 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:50:45.484981 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 11:50:45.484981 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 11:50:45.484981 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 11:50:45.484981 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 11:50:45.484981 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 11:50:45.484981 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 11:50:45.484981 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 23 11:50:45.484981 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 23 11:50:45.484981 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume dd5302c9-15df-4e97-98eb-70965c9010f1 is already attached to instances: 250e2ce6-70ad-4082-8073-6a9cea0ca1e4 Jun 23 11:50:45.484981 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:50:45.484981 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:50:45.484981 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:50:45.484981 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:50:45.484981 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:50:45.487087 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:50:45.487087 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:50:45.487087 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:50:45.487087 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume dd5302c9-15df-4e97-98eb-70965c9010f1 is already attached to instances: 250e2ce6-70ad-4082-8073-6a9cea0ca1e4 Jun 23 11:50:45.487087 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:50:45.487087 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-6e947c91-df33-48ee-9d41-145f6cc32c3d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Returning 400 to user: Invalid volume: volume dd5302c9-15df-4e97-98eb-70965c9010f1 is already attached to instances: 250e2ce6-70ad-4082-8073-6a9cea0ca1e4 {{(pid=124669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:50:45.487087 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-6e947c91-df33-48ee-9d41-145f6cc32c3d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "POST /compute/v2.1/servers/76c7fe26-3425-4f59-8a7e-4281b4b6ed3f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.094731 Jun 23 11:50:45.487087 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 338/711] 10.222.0.13 () {60 vars in 1322 bytes} [Thu Jun 23 11:50:45 2022] POST /compute/v2.1/servers/76c7fe26-3425-4f59-8a7e-4281b4b6ed3f/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 23 11:50:45.491229 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-0e106e36-b0a1-4aaf-b9fd-cfcea6e08925 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:45.491731 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-0e106e36-b0a1-4aaf-b9fd-cfcea6e08925 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 76c7fe26-3425-4f59-8a7e-4281b4b6ed3f] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:45.500814 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-0e106e36-b0a1-4aaf-b9fd-cfcea6e08925 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:45.501194 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-0e106e36-b0a1-4aaf-b9fd-cfcea6e08925 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:45.501973 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-0e106e36-b0a1-4aaf-b9fd-cfcea6e08925 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:45.502415 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-0e106e36-b0a1-4aaf-b9fd-cfcea6e08925 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:45.528344 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-0e106e36-b0a1-4aaf-b9fd-cfcea6e08925 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 76c7fe26-3425-4f59-8a7e-4281b4b6ed3f] Going to try to terminate instance {{(pid=124669) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 11:50:45.600719 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-d35f79e4-1c9d-44c6-ad93-61057b2e47b2 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:45.608416 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-d35f79e4-1c9d-44c6-ad93-61057b2e47b2 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 200 len: 1680 microversion: 2.1 time: 0.151319 Jun 23 11:50:45.608971 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 374/712] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:50:45 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:50:45.751825 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-b531c4a6-b6a3-45ed-bb5a-626283b7bb4b tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:45.752344 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-b531c4a6-b6a3-45ed-bb5a-626283b7bb4b tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] [instance: c026366c-311a-45eb-899c-30703cd7eb1d] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:45.758202 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-b531c4a6-b6a3-45ed-bb5a-626283b7bb4b tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:45.761837 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-b531c4a6-b6a3-45ed-bb5a-626283b7bb4b tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:45.761837 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-b531c4a6-b6a3-45ed-bb5a-626283b7bb4b tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:45.761837 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-b531c4a6-b6a3-45ed-bb5a-626283b7bb4b tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:45.805424 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-0e106e36-b0a1-4aaf-b9fd-cfcea6e08925 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "DELETE /compute/v2.1/servers/76c7fe26-3425-4f59-8a7e-4281b4b6ed3f" status: 204 len: 0 microversion: 2.1 time: 0.317617 Jun 23 11:50:45.806172 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 339/713] 10.222.0.13 () {58 vars in 1238 bytes} [Thu Jun 23 11:50:45 2022] DELETE /compute/v2.1/servers/76c7fe26-3425-4f59-8a7e-4281b4b6ed3f => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 11:50:45.815113 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-3be18572-05c7-4189-a69c-46d31ffa2d4d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:45.815788 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-3be18572-05c7-4189-a69c-46d31ffa2d4d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 76c7fe26-3425-4f59-8a7e-4281b4b6ed3f] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:45.821836 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-3be18572-05c7-4189-a69c-46d31ffa2d4d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:45.822282 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-3be18572-05c7-4189-a69c-46d31ffa2d4d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:45.823090 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-3be18572-05c7-4189-a69c-46d31ffa2d4d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:45.824689 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-3be18572-05c7-4189-a69c-46d31ffa2d4d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:45.934631 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-b531c4a6-b6a3-45ed-bb5a-626283b7bb4b tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626c3dbdc0f1407db82d6988e68e40b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce01d9a78d3f4bb7b101b47548b73037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:45.942397 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-b531c4a6-b6a3-45ed-bb5a-626283b7bb4b tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] 10.222.0.13 "GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d" status: 200 len: 1575 microversion: 2.1 time: 0.194403 Jun 23 11:50:45.943122 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 375/714] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:50:45 2022] GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d => generated 1575 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:50:45.979064 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-3be18572-05c7-4189-a69c-46d31ffa2d4d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:45.986559 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-3be18572-05c7-4189-a69c-46d31ffa2d4d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/76c7fe26-3425-4f59-8a7e-4281b4b6ed3f" status: 200 len: 1680 microversion: 2.1 time: 0.175485 Jun 23 11:50:45.987101 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 340/715] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:50:45 2022] GET /compute/v2.1/servers/76c7fe26-3425-4f59-8a7e-4281b4b6ed3f => generated 1680 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:50:46.624527 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-5a933963-f2a7-410b-aed5-6e28f202e27b tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:46.625127 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-5a933963-f2a7-410b-aed5-6e28f202e27b tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:46.631168 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-5a933963-f2a7-410b-aed5-6e28f202e27b tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:46.631614 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-5a933963-f2a7-410b-aed5-6e28f202e27b tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:46.632356 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-5a933963-f2a7-410b-aed5-6e28f202e27b tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:46.632784 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-5a933963-f2a7-410b-aed5-6e28f202e27b tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:46.763807 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-5a933963-f2a7-410b-aed5-6e28f202e27b tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:46.771224 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-5a933963-f2a7-410b-aed5-6e28f202e27b tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 200 len: 1680 microversion: 2.1 time: 0.150560 Jun 23 11:50:46.771782 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 376/716] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:50:46 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:50:46.960446 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-2c03bab0-df19-4a81-ab04-e86d718e47ae tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:46.961154 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-2c03bab0-df19-4a81-ab04-e86d718e47ae tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] [instance: c026366c-311a-45eb-899c-30703cd7eb1d] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:46.968619 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-2c03bab0-df19-4a81-ab04-e86d718e47ae tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:46.971173 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-2c03bab0-df19-4a81-ab04-e86d718e47ae tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:46.971173 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-2c03bab0-df19-4a81-ab04-e86d718e47ae tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:46.971173 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-2c03bab0-df19-4a81-ab04-e86d718e47ae tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:47.004457 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-f913eba6-7940-4c44-bfcd-a511799c96d4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:47.005058 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-f913eba6-7940-4c44-bfcd-a511799c96d4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 76c7fe26-3425-4f59-8a7e-4281b4b6ed3f] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:47.011364 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-f913eba6-7940-4c44-bfcd-a511799c96d4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:47.012260 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-f913eba6-7940-4c44-bfcd-a511799c96d4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:47.013709 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-f913eba6-7940-4c44-bfcd-a511799c96d4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:47.014136 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-f913eba6-7940-4c44-bfcd-a511799c96d4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:47.152885 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-2c03bab0-df19-4a81-ab04-e86d718e47ae tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626c3dbdc0f1407db82d6988e68e40b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce01d9a78d3f4bb7b101b47548b73037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:47.160871 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-2c03bab0-df19-4a81-ab04-e86d718e47ae tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] 10.222.0.13 "GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d" status: 200 len: 1575 microversion: 2.1 time: 0.204316 Jun 23 11:50:47.161437 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 341/717] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:50:46 2022] GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d => generated 1575 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:50:47.174341 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-f913eba6-7940-4c44-bfcd-a511799c96d4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:47.181924 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-f913eba6-7940-4c44-bfcd-a511799c96d4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/76c7fe26-3425-4f59-8a7e-4281b4b6ed3f" status: 200 len: 1680 microversion: 2.1 time: 0.181217 Jun 23 11:50:47.182518 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 377/718] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:50:46 2022] GET /compute/v2.1/servers/76c7fe26-3425-4f59-8a7e-4281b4b6ed3f => generated 1680 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:50:47.787759 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-991ca394-b00b-4e46-a603-8a189afdc273 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:47.788365 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-991ca394-b00b-4e46-a603-8a189afdc273 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:47.795537 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-991ca394-b00b-4e46-a603-8a189afdc273 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:47.795987 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-991ca394-b00b-4e46-a603-8a189afdc273 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:47.796735 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-991ca394-b00b-4e46-a603-8a189afdc273 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:47.797186 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-991ca394-b00b-4e46-a603-8a189afdc273 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:47.925960 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-991ca394-b00b-4e46-a603-8a189afdc273 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:47.933368 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-991ca394-b00b-4e46-a603-8a189afdc273 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 200 len: 1680 microversion: 2.1 time: 0.149495 Jun 23 11:50:47.934717 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 342/719] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:50:47 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:50:48.178796 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-a35f004a-8ce7-42ec-a39b-2f37bed0414d tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:48.179425 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-a35f004a-8ce7-42ec-a39b-2f37bed0414d tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] [instance: c026366c-311a-45eb-899c-30703cd7eb1d] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:48.185921 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a35f004a-8ce7-42ec-a39b-2f37bed0414d tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:48.186364 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a35f004a-8ce7-42ec-a39b-2f37bed0414d tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:48.187143 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a35f004a-8ce7-42ec-a39b-2f37bed0414d tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:48.187574 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a35f004a-8ce7-42ec-a39b-2f37bed0414d tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:48.209109 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-44a21e7a-6cf2-4f4b-ac9c-7fc48e249a4d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:48.209724 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-44a21e7a-6cf2-4f4b-ac9c-7fc48e249a4d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 76c7fe26-3425-4f59-8a7e-4281b4b6ed3f] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:48.216943 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-44a21e7a-6cf2-4f4b-ac9c-7fc48e249a4d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:48.217770 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-44a21e7a-6cf2-4f4b-ac9c-7fc48e249a4d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:48.218144 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-44a21e7a-6cf2-4f4b-ac9c-7fc48e249a4d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:48.218607 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-44a21e7a-6cf2-4f4b-ac9c-7fc48e249a4d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:48.374742 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-a35f004a-8ce7-42ec-a39b-2f37bed0414d tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626c3dbdc0f1407db82d6988e68e40b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce01d9a78d3f4bb7b101b47548b73037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:48.382830 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-a35f004a-8ce7-42ec-a39b-2f37bed0414d tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] 10.222.0.13 "GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d" status: 200 len: 1575 microversion: 2.1 time: 0.207853 Jun 23 11:50:48.383395 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 378/720] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:50:48 2022] GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d => generated 1575 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:50:48.395806 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-44a21e7a-6cf2-4f4b-ac9c-7fc48e249a4d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:48.403960 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-44a21e7a-6cf2-4f4b-ac9c-7fc48e249a4d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/76c7fe26-3425-4f59-8a7e-4281b4b6ed3f" status: 200 len: 1680 microversion: 2.1 time: 0.200344 Jun 23 11:50:48.404518 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 343/721] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:50:48 2022] GET /compute/v2.1/servers/76c7fe26-3425-4f59-8a7e-4281b4b6ed3f => generated 1680 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:50:48.951552 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-6a4b3a05-558e-47a7-a99f-57dc50b8f29f tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:48.952494 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-6a4b3a05-558e-47a7-a99f-57dc50b8f29f tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:48.958925 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-6a4b3a05-558e-47a7-a99f-57dc50b8f29f tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:48.959296 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-6a4b3a05-558e-47a7-a99f-57dc50b8f29f tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:48.961237 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-6a4b3a05-558e-47a7-a99f-57dc50b8f29f tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:48.961237 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-6a4b3a05-558e-47a7-a99f-57dc50b8f29f tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:49.116397 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-6a4b3a05-558e-47a7-a99f-57dc50b8f29f tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:49.125435 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-6a4b3a05-558e-47a7-a99f-57dc50b8f29f tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 200 len: 1680 microversion: 2.1 time: 0.178284 Jun 23 11:50:49.126018 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 379/722] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:50:48 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 1680 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:50:49.401024 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-bd3813a2-31ae-4af8-85b3-1571997e8a1b tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:49.401735 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-bd3813a2-31ae-4af8-85b3-1571997e8a1b tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] [instance: c026366c-311a-45eb-899c-30703cd7eb1d] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:49.408774 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-bd3813a2-31ae-4af8-85b3-1571997e8a1b tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:49.409230 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-bd3813a2-31ae-4af8-85b3-1571997e8a1b tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:49.410008 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-bd3813a2-31ae-4af8-85b3-1571997e8a1b tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:49.410444 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-bd3813a2-31ae-4af8-85b3-1571997e8a1b tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:49.423256 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-ee4a3ee4-4b51-4bb9-91da-82205e1222a2 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:49.424469 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-ee4a3ee4-4b51-4bb9-91da-82205e1222a2 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 76c7fe26-3425-4f59-8a7e-4281b4b6ed3f] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:49.430699 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-ee4a3ee4-4b51-4bb9-91da-82205e1222a2 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:49.431188 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-ee4a3ee4-4b51-4bb9-91da-82205e1222a2 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:49.431966 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-ee4a3ee4-4b51-4bb9-91da-82205e1222a2 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:49.432399 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-ee4a3ee4-4b51-4bb9-91da-82205e1222a2 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:49.620603 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-bd3813a2-31ae-4af8-85b3-1571997e8a1b tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626c3dbdc0f1407db82d6988e68e40b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce01d9a78d3f4bb7b101b47548b73037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:49.624675 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:50:49.629372 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-bd3813a2-31ae-4af8-85b3-1571997e8a1b tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] 10.222.0.13 "GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d" status: 200 len: 1575 microversion: 2.1 time: 0.232287 Jun 23 11:50:49.630166 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 344/723] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:50:49 2022] GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d => generated 1575 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:50:49.649536 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-ee4a3ee4-4b51-4bb9-91da-82205e1222a2 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:49.658381 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-ee4a3ee4-4b51-4bb9-91da-82205e1222a2 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/76c7fe26-3425-4f59-8a7e-4281b4b6ed3f" status: 200 len: 1680 microversion: 2.1 time: 0.239278 Jun 23 11:50:49.658976 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 380/724] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:50:49 2022] GET /compute/v2.1/servers/76c7fe26-3425-4f59-8a7e-4281b4b6ed3f => generated 1680 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:50:50.053052 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [req-b945bdcd-8435-4703-934e-97a953e5718f req-5854d2fe-2911-4326-ada4-8f0231b8cd39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76c7fe26-3425-4f59-8a7e-4281b4b6ed3f", "name": "network-vif-deleted", "tag": "6c53408c-0865-4915-8148-5fd2f10f06a9"}]} {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:50:50.067898 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [req-b945bdcd-8435-4703-934e-97a953e5718f req-5854d2fe-2911-4326-ada4-8f0231b8cd39 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:50.068346 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [req-b945bdcd-8435-4703-934e-97a953e5718f req-5854d2fe-2911-4326-ada4-8f0231b8cd39 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:50.084266 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.compute.server_external_events [req-b945bdcd-8435-4703-934e-97a953e5718f req-5854d2fe-2911-4326-ada4-8f0231b8cd39 service nova] Creating event network-vif-deleted:6c53408c-0865-4915-8148-5fd2f10f06a9 for instance 76c7fe26-3425-4f59-8a7e-4281b4b6ed3f on hv-cinder-82099 Jun 23 11:50:50.089065 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [req-b945bdcd-8435-4703-934e-97a953e5718f req-5854d2fe-2911-4326-ada4-8f0231b8cd39 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039932 Jun 23 11:50:50.095125 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 345/725] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:50:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:50:50.144687 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-68fc9d81-a9b9-40fc-b20f-b2d1dec0e76e tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:50.145879 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-68fc9d81-a9b9-40fc-b20f-b2d1dec0e76e tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:50.154700 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-68fc9d81-a9b9-40fc-b20f-b2d1dec0e76e tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:50.160380 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-68fc9d81-a9b9-40fc-b20f-b2d1dec0e76e tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:50.160380 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-68fc9d81-a9b9-40fc-b20f-b2d1dec0e76e tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:50.160380 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-68fc9d81-a9b9-40fc-b20f-b2d1dec0e76e tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:50.308059 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-68fc9d81-a9b9-40fc-b20f-b2d1dec0e76e tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:50.317775 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-68fc9d81-a9b9-40fc-b20f-b2d1dec0e76e tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 200 len: 1657 microversion: 2.1 time: 0.177898 Jun 23 11:50:50.336462 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-fc4a4790-45a0-4777-82d6-a7a94abd9700 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:50:50.342813 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 381/726] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:50:50 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 1657 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:50:50.347415 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-fc4a4790-45a0-4777-82d6-a7a94abd9700 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:50.347861 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-fc4a4790-45a0-4777-82d6-a7a94abd9700 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:50.372671 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-fc4a4790-45a0-4777-82d6-a7a94abd9700 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Going to try to start instance {{(pid=124669) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 23 11:50:50.569645 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-fc4a4790-45a0-4777-82d6-a7a94abd9700 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "POST /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200/action" status: 202 len: 0 microversion: 2.1 time: 0.237979 Jun 23 11:50:50.570303 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 346/727] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Jun 23 11:50:50 2022] POST /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 11:50:50.579300 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-c7c507f9-f8f4-4eb0-a57d-5b2171812bdd tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:50.579902 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-c7c507f9-f8f4-4eb0-a57d-5b2171812bdd tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:50.586296 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-c7c507f9-f8f4-4eb0-a57d-5b2171812bdd tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:50.586783 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-c7c507f9-f8f4-4eb0-a57d-5b2171812bdd tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:50.587525 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-c7c507f9-f8f4-4eb0-a57d-5b2171812bdd tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:50.587952 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-c7c507f9-f8f4-4eb0-a57d-5b2171812bdd tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:50.647493 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-0b8b36df-bc48-44b5-8359-aacc74545b7a tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:50.656054 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-0b8b36df-bc48-44b5-8359-aacc74545b7a tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] [instance: c026366c-311a-45eb-899c-30703cd7eb1d] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:50.657057 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-0b8b36df-bc48-44b5-8359-aacc74545b7a tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:50.657968 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-0b8b36df-bc48-44b5-8359-aacc74545b7a tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:50.659195 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-0b8b36df-bc48-44b5-8359-aacc74545b7a tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:50.659790 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-0b8b36df-bc48-44b5-8359-aacc74545b7a tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:50.814975 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-c7c507f9-f8f4-4eb0-a57d-5b2171812bdd tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:50.846345 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-c7c507f9-f8f4-4eb0-a57d-5b2171812bdd tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 200 len: 1666 microversion: 2.1 time: 0.268296 Jun 23 11:50:50.847694 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 382/728] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:50:50 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 1666 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:50:50.856309 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-0b8b36df-bc48-44b5-8359-aacc74545b7a tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626c3dbdc0f1407db82d6988e68e40b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce01d9a78d3f4bb7b101b47548b73037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:50.857230 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-45357c01-5ab7-4b6c-8780-b341aa52af6f tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:50.858286 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-45357c01-5ab7-4b6c-8780-b341aa52af6f tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 76c7fe26-3425-4f59-8a7e-4281b4b6ed3f] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:50.867154 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-0b8b36df-bc48-44b5-8359-aacc74545b7a tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] 10.222.0.13 "GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d" status: 200 len: 1575 microversion: 2.1 time: 0.223421 Jun 23 11:50:50.868037 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-45357c01-5ab7-4b6c-8780-b341aa52af6f tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:50.881114 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 347/729] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:50:50 2022] GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d => generated 1575 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:50:50.881596 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-45357c01-5ab7-4b6c-8780-b341aa52af6f tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:50.881596 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-45357c01-5ab7-4b6c-8780-b341aa52af6f tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:50.881596 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-45357c01-5ab7-4b6c-8780-b341aa52af6f tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:50.932801 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-45357c01-5ab7-4b6c-8780-b341aa52af6f tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:50.933422 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-45357c01-5ab7-4b6c-8780-b341aa52af6f tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:50.934436 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.objects.instance [None req-45357c01-5ab7-4b6c-8780-b341aa52af6f tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lazy-loading 'fault' on Instance uuid 76c7fe26-3425-4f59-8a7e-4281b4b6ed3f {{(pid=124670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:50:50.936492 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_cell1:SELECT=100 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:50:51.012565 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-45357c01-5ab7-4b6c-8780-b341aa52af6f tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:51.021117 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-45357c01-5ab7-4b6c-8780-b341aa52af6f tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/76c7fe26-3425-4f59-8a7e-4281b4b6ed3f" status: 200 len: 1332 microversion: 2.1 time: 0.171979 Jun 23 11:50:51.021923 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 383/730] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:50:50 2022] GET /compute/v2.1/servers/76c7fe26-3425-4f59-8a7e-4281b4b6ed3f => generated 1332 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:50:51.863865 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-adbff22a-1023-4785-b117-4b588bb41de2 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:51.864582 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-adbff22a-1023-4785-b117-4b588bb41de2 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:51.870630 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-adbff22a-1023-4785-b117-4b588bb41de2 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:51.871571 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-adbff22a-1023-4785-b117-4b588bb41de2 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:51.872782 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-adbff22a-1023-4785-b117-4b588bb41de2 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:51.873219 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-adbff22a-1023-4785-b117-4b588bb41de2 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:51.884569 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-f2ec1091-7f3d-4757-b599-de09e4fa3d89 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:51.885186 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-f2ec1091-7f3d-4757-b599-de09e4fa3d89 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] [instance: c026366c-311a-45eb-899c-30703cd7eb1d] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:51.892116 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-f2ec1091-7f3d-4757-b599-de09e4fa3d89 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:51.892637 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-f2ec1091-7f3d-4757-b599-de09e4fa3d89 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:51.893405 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-f2ec1091-7f3d-4757-b599-de09e4fa3d89 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:51.893837 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-f2ec1091-7f3d-4757-b599-de09e4fa3d89 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:52.077815 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-adbff22a-1023-4785-b117-4b588bb41de2 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:52.081047 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-f2ec1091-7f3d-4757-b599-de09e4fa3d89 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626c3dbdc0f1407db82d6988e68e40b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce01d9a78d3f4bb7b101b47548b73037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:52.091730 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-f2ec1091-7f3d-4757-b599-de09e4fa3d89 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] 10.222.0.13 "GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d" status: 200 len: 1575 microversion: 2.1 time: 0.210809 Jun 23 11:50:52.092347 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 384/731] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:50:51 2022] GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d => generated 1575 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:50:52.097747 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-53525e09-7e42-4735-8d05-2feb059b7447 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:52.098565 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-53525e09-7e42-4735-8d05-2feb059b7447 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 76c7fe26-3425-4f59-8a7e-4281b4b6ed3f] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:52.099919 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-adbff22a-1023-4785-b117-4b588bb41de2 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 200 len: 1666 microversion: 2.1 time: 0.239881 Jun 23 11:50:52.100934 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 348/732] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:50:51 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 1666 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:50:52.106229 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-53525e09-7e42-4735-8d05-2feb059b7447 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:52.106946 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-53525e09-7e42-4735-8d05-2feb059b7447 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:52.107746 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-53525e09-7e42-4735-8d05-2feb059b7447 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:52.108172 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-53525e09-7e42-4735-8d05-2feb059b7447 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:52.127701 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.wsgi [None req-53525e09-7e42-4735-8d05-2feb059b7447 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] HTTP exception thrown: Instance 76c7fe26-3425-4f59-8a7e-4281b4b6ed3f could not be found. Jun 23 11:50:52.129453 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-53525e09-7e42-4735-8d05-2feb059b7447 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Request method failure captured: Jun 23 11:50:52.129453 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: request: GET /compute/v2.1/servers/76c7fe26-3425-4f59-8a7e-4281b4b6ed3f HTTP/1.1 Jun 23 11:50:52.129453 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Accept: application/json Jun 23 11:50:52.129453 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Accept-Encoding: identity Jun 23 11:50:52.129453 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Connection: close Jun 23 11:50:52.129453 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Content-Length: 0 Jun 23 11:50:52.129453 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Content-Type: application/json Jun 23 11:50:52.129453 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Host: 10.222.0.13 Jun 23 11:50:52.129453 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Openstack-System-Scope: None Jun 23 11:50:52.129453 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: User-Agent: python-urllib3/1.26.9 Jun 23 11:50:52.129453 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Auth-Token: gAAAAABitFIKMke7vIBbvXT2RfPc-4frmGbwTZtMddIa6SPtgPblRzRqc8HMry6yk8WPdy-omEmS4IGKEBZ0krkMZ2AKKZ3XIi6QwXYCvuOyoif5_u-lfFNTFOpNeH9m810_qoSsO3823Vbqo3_NJM0PRtSxfQcTjP265INpx0gWYDOG-d8IrtY Jun 23 11:50:52.129453 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Domain-Id: None Jun 23 11:50:52.129453 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Domain-Name: None Jun 23 11:50:52.129453 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Identity-Status: Confirmed Jun 23 11:50:52.129453 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Is-Admin-Project: True Jun 23 11:50:52.129453 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Domain-Id: default Jun 23 11:50:52.129453 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Domain-Name: Default Jun 23 11:50:52.129453 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Id: ee135767dfc846469d64b658372994a8 Jun 23 11:50:52.129453 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Name: tempest-AttachVolumeNegativeTest-213077295 Jun 23 11:50:52.129453 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Role: member,reader Jun 23 11:50:52.129453 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Roles: member,reader Jun 23 11:50:52.131095 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ee135767dfc846469d64b658372994a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ee135767dfc846469d64b658372994a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ee135767dfc846469d64b658372994a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ee135767dfc846469d64b658372994a8"}]}] Jun 23 11:50:52.131095 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Tenant: tempest-AttachVolumeNegativeTest-213077295 Jun 23 11:50:52.131095 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Tenant-Id: ee135767dfc846469d64b658372994a8 Jun 23 11:50:52.131095 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-213077295 Jun 23 11:50:52.131095 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User: tempest-AttachVolumeNegativeTest-213077295-project Jun 23 11:50:52.131095 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Domain-Id: default Jun 23 11:50:52.131095 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Domain-Name: Default Jun 23 11:50:52.131095 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Id: b7fd8323d29d445f903e2103453e8ae6 Jun 23 11:50:52.131095 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Name: tempest-AttachVolumeNegativeTest-213077295-project Jun 23 11:50:52.131095 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: method: > Jun 23 11:50:52.131095 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: exception: Instance 76c7fe26-3425-4f59-8a7e-4281b4b6ed3f could not be found. Jun 23 11:50:52.131095 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: action_args: {'id': '76c7fe26-3425-4f59-8a7e-4281b4b6ed3f'} Jun 23 11:50:52.131993 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:50:52.131993 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:50:52.131993 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:50:52.131993 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:50:52.131993 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:50:52.131993 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:50:52.131993 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:50:52.131993 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:50:52.131993 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:50:52.131993 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:50:52.131993 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76c7fe26-3425-4f59-8a7e-4281b4b6ed3f could not be found. Jun 23 11:50:52.131993 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:50:52.131993 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:50:52.131993 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:50:52.131993 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:50:52.131993 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:50:52.131993 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:50:52.131993 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:50:52.131993 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:50:52.131993 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:50:52.137357 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:50:52.137357 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 11:50:52.137357 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 11:50:52.137357 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:50:52.137357 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:50:52.137357 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:50:52.137357 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:50:52.137357 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76c7fe26-3425-4f59-8a7e-4281b4b6ed3f could not be found. Jun 23 11:50:52.137357 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:50:52.137357 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:50:52.137357 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:50:52.137357 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:50:52.137357 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:50:52.137357 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:50:52.137357 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:50:52.137357 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:50:52.137357 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76c7fe26-3425-4f59-8a7e-4281b4b6ed3f could not be found. Jun 23 11:50:52.137357 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:50:52.138758 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-53525e09-7e42-4735-8d05-2feb059b7447 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Returning 404 to user: Instance 76c7fe26-3425-4f59-8a7e-4281b4b6ed3f could not be found. {{(pid=124670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:50:52.138758 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-53525e09-7e42-4735-8d05-2feb059b7447 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/76c7fe26-3425-4f59-8a7e-4281b4b6ed3f" status: 404 len: 111 microversion: 2.1 time: 0.038097 Jun 23 11:50:52.138758 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 385/733] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:50:52 2022] GET /compute/v2.1/servers/76c7fe26-3425-4f59-8a7e-4281b4b6ed3f => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:50:52.143048 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-b8fbeb4a-9b17-4530-9f15-39e2298e8501 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '.version_select at 0x7f5d064f2790>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:52.146639 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b8fbeb4a-9b17-4530-9f15-39e2298e8501 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [150b2a3e-2932-41ac-8950-a7e8128580c5] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 23 11:50:53.109321 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-d7ad0418-59fa-449e-9fe9-71e4c19c6be5 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:53.109951 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-d7ad0418-59fa-449e-9fe9-71e4c19c6be5 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] [instance: c026366c-311a-45eb-899c-30703cd7eb1d] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:53.115928 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-d7ad0418-59fa-449e-9fe9-71e4c19c6be5 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:53.116381 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-d7ad0418-59fa-449e-9fe9-71e4c19c6be5 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:53.117136 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-d7ad0418-59fa-449e-9fe9-71e4c19c6be5 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:53.117569 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-d7ad0418-59fa-449e-9fe9-71e4c19c6be5 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:53.154661 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO oslo.messaging._drivers.impl_rabbit [None req-b8fbeb4a-9b17-4530-9f15-39e2298e8501 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [150b2a3e-2932-41ac-8950-a7e8128580c5] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 41666. Jun 23 11:50:53.232705 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-b8fbeb4a-9b17-4530-9f15-39e2298e8501 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1392421927" status: 202 len: 0 microversion: 2.1 time: 1.094793 Jun 23 11:50:53.233418 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 349/734] 10.222.0.13 () {58 vars in 1220 bytes} [Thu Jun 23 11:50:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1392421927 => generated 0 bytes in 1097 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 11:50:53.238640 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-77a34d35-66e6-4070-a9c3-c116c14e1d41 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:53.239384 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-77a34d35-66e6-4070-a9c3-c116c14e1d41 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:53.246713 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-77a34d35-66e6-4070-a9c3-c116c14e1d41 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:53.247804 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-77a34d35-66e6-4070-a9c3-c116c14e1d41 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:53.248835 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-77a34d35-66e6-4070-a9c3-c116c14e1d41 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:53.249282 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-77a34d35-66e6-4070-a9c3-c116c14e1d41 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:53.252764 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-d7ad0418-59fa-449e-9fe9-71e4c19c6be5 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626c3dbdc0f1407db82d6988e68e40b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce01d9a78d3f4bb7b101b47548b73037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:53.261050 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-d7ad0418-59fa-449e-9fe9-71e4c19c6be5 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] 10.222.0.13 "GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d" status: 200 len: 1575 microversion: 2.1 time: 0.155734 Jun 23 11:50:53.262234 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 386/735] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:50:53 2022] GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:50:53.380297 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-77a34d35-66e6-4070-a9c3-c116c14e1d41 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:53.387789 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-77a34d35-66e6-4070-a9c3-c116c14e1d41 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 200 len: 1670 microversion: 2.1 time: 0.153236 Jun 23 11:50:53.388435 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 350/736] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:50:53 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 1670 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:50:54.044891 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-399d85c8-877f-48b4-b0af-aeaca5a2ace4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:54.045048 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-399d85c8-877f-48b4-b0af-aeaca5a2ace4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 250e2ce6-70ad-4082-8073-6a9cea0ca1e4] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:54.051229 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-399d85c8-877f-48b4-b0af-aeaca5a2ace4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:54.051674 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-399d85c8-877f-48b4-b0af-aeaca5a2ace4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:54.052460 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-399d85c8-877f-48b4-b0af-aeaca5a2ace4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:54.052890 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-399d85c8-877f-48b4-b0af-aeaca5a2ace4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:54.182161 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.objects.instance [None req-399d85c8-877f-48b4-b0af-aeaca5a2ace4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lazy-loading 'services' on Instance uuid 250e2ce6-70ad-4082-8073-6a9cea0ca1e4 {{(pid=124670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:50:54.194736 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [req-188d3630-6abd-457b-b0bf-29ceb7fefb00 req-a5db3408-fb4f-4d21-8a8f-c9e0f80d2902 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c026366c-311a-45eb-899c-30703cd7eb1d", "name": "network-vif-plugged", "status": "completed", "tag": "0d774b3d-b1c7-415f-9da5-0abe6a54a4eb"}]} {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:50:54.204097 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [req-188d3630-6abd-457b-b0bf-29ceb7fefb00 req-a5db3408-fb4f-4d21-8a8f-c9e0f80d2902 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:54.204538 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [req-188d3630-6abd-457b-b0bf-29ceb7fefb00 req-a5db3408-fb4f-4d21-8a8f-c9e0f80d2902 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:54.215466 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.compute.server_external_events [req-188d3630-6abd-457b-b0bf-29ceb7fefb00 req-a5db3408-fb4f-4d21-8a8f-c9e0f80d2902 service nova] Creating event network-vif-plugged:0d774b3d-b1c7-415f-9da5-0abe6a54a4eb for instance c026366c-311a-45eb-899c-30703cd7eb1d on hv-cinder-82099 Jun 23 11:50:54.221155 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [req-188d3630-6abd-457b-b0bf-29ceb7fefb00 req-a5db3408-fb4f-4d21-8a8f-c9e0f80d2902 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030036 Jun 23 11:50:54.221740 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 351/737] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:50:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:50:54.280037 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-484c2440-25ca-45bd-9ad3-a118f6d81c8d tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:54.280861 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-484c2440-25ca-45bd-9ad3-a118f6d81c8d tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] [instance: c026366c-311a-45eb-899c-30703cd7eb1d] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:54.287378 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-484c2440-25ca-45bd-9ad3-a118f6d81c8d tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:54.287907 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-484c2440-25ca-45bd-9ad3-a118f6d81c8d tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:54.288737 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-484c2440-25ca-45bd-9ad3-a118f6d81c8d tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:54.289251 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-484c2440-25ca-45bd-9ad3-a118f6d81c8d tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:54.427979 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-484c2440-25ca-45bd-9ad3-a118f6d81c8d tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626c3dbdc0f1407db82d6988e68e40b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce01d9a78d3f4bb7b101b47548b73037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:54.436121 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-484c2440-25ca-45bd-9ad3-a118f6d81c8d tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] 10.222.0.13 "GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d" status: 200 len: 1575 microversion: 2.1 time: 0.160636 Jun 23 11:50:54.436682 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 352/738] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:50:54 2022] GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:50:54.479117 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-399d85c8-877f-48b4-b0af-aeaca5a2ace4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "DELETE /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4/os-volume_attachments/dd5302c9-15df-4e97-98eb-70965c9010f1" status: 202 len: 0 microversion: 2.1 time: 0.438814 Jun 23 11:50:54.479722 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 387/739] 10.222.0.13 () {58 vars in 1415 bytes} [Thu Jun 23 11:50:54 2022] DELETE /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4/os-volume_attachments/dd5302c9-15df-4e97-98eb-70965c9010f1 => generated 0 bytes in 440 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 11:50:54.489003 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-63309866-ef5e-4b73-8db5-6b468ee168d2 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:54.490180 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-63309866-ef5e-4b73-8db5-6b468ee168d2 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 250e2ce6-70ad-4082-8073-6a9cea0ca1e4] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:54.497879 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-63309866-ef5e-4b73-8db5-6b468ee168d2 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:54.498956 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-63309866-ef5e-4b73-8db5-6b468ee168d2 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:54.499705 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-63309866-ef5e-4b73-8db5-6b468ee168d2 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:54.500140 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-63309866-ef5e-4b73-8db5-6b468ee168d2 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:54.531564 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-63309866-ef5e-4b73-8db5-6b468ee168d2 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046442 Jun 23 11:50:54.532126 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 353/740] 10.222.0.13 () {58 vars in 1301 bytes} [Thu Jun 23 11:50:54 2022] GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:50:55.454632 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-a24a4179-489b-4743-900e-386b5374bf5e tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:55.455335 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-a24a4179-489b-4743-900e-386b5374bf5e tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] [instance: c026366c-311a-45eb-899c-30703cd7eb1d] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:55.461816 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a24a4179-489b-4743-900e-386b5374bf5e tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:55.462311 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a24a4179-489b-4743-900e-386b5374bf5e tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:55.463150 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a24a4179-489b-4743-900e-386b5374bf5e tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:55.463583 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a24a4179-489b-4743-900e-386b5374bf5e tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:55.543127 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-872fae5e-6a84-459a-8e87-c98d2b5b943a tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:55.544106 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-872fae5e-6a84-459a-8e87-c98d2b5b943a tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 250e2ce6-70ad-4082-8073-6a9cea0ca1e4] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:55.550912 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-872fae5e-6a84-459a-8e87-c98d2b5b943a tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:55.551363 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-872fae5e-6a84-459a-8e87-c98d2b5b943a tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:55.552125 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-872fae5e-6a84-459a-8e87-c98d2b5b943a tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:55.552561 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-872fae5e-6a84-459a-8e87-c98d2b5b943a tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:55.584679 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-872fae5e-6a84-459a-8e87-c98d2b5b943a tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045381 Jun 23 11:50:55.585437 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 354/741] 10.222.0.13 () {58 vars in 1301 bytes} [Thu Jun 23 11:50:55 2022] GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:50:55.596536 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-a24a4179-489b-4743-900e-386b5374bf5e tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626c3dbdc0f1407db82d6988e68e40b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce01d9a78d3f4bb7b101b47548b73037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:55.604167 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-a24a4179-489b-4743-900e-386b5374bf5e tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] 10.222.0.13 "GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d" status: 200 len: 1575 microversion: 2.1 time: 0.154766 Jun 23 11:50:55.604729 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 388/742] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:50:55 2022] GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:50:56.597617 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-c9d0a995-0c3a-4610-a306-ab0de9a8c269 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:56.598562 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-c9d0a995-0c3a-4610-a306-ab0de9a8c269 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 250e2ce6-70ad-4082-8073-6a9cea0ca1e4] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:56.605028 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c9d0a995-0c3a-4610-a306-ab0de9a8c269 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:56.605484 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c9d0a995-0c3a-4610-a306-ab0de9a8c269 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:56.606243 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c9d0a995-0c3a-4610-a306-ab0de9a8c269 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:56.607076 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c9d0a995-0c3a-4610-a306-ab0de9a8c269 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:56.620920 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-0551aaa6-47fe-46b4-83e5-593721562f98 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:56.621527 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-0551aaa6-47fe-46b4-83e5-593721562f98 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] [instance: c026366c-311a-45eb-899c-30703cd7eb1d] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:56.627577 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-0551aaa6-47fe-46b4-83e5-593721562f98 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:56.628024 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-0551aaa6-47fe-46b4-83e5-593721562f98 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:56.628782 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-0551aaa6-47fe-46b4-83e5-593721562f98 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:56.629220 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-0551aaa6-47fe-46b4-83e5-593721562f98 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:56.635567 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-c9d0a995-0c3a-4610-a306-ab0de9a8c269 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042147 Jun 23 11:50:56.636125 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 355/743] 10.222.0.13 () {58 vars in 1301 bytes} [Thu Jun 23 11:50:56 2022] GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:50:56.762157 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-0551aaa6-47fe-46b4-83e5-593721562f98 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626c3dbdc0f1407db82d6988e68e40b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce01d9a78d3f4bb7b101b47548b73037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:56.770347 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-0551aaa6-47fe-46b4-83e5-593721562f98 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] 10.222.0.13 "GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d" status: 200 len: 1575 microversion: 2.1 time: 0.153245 Jun 23 11:50:56.770935 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 389/744] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:50:56 2022] GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:50:57.647716 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-c5fb2b06-3d62-4d9a-a486-32686f4d0cf9 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:57.648639 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-c5fb2b06-3d62-4d9a-a486-32686f4d0cf9 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 250e2ce6-70ad-4082-8073-6a9cea0ca1e4] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:57.655672 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c5fb2b06-3d62-4d9a-a486-32686f4d0cf9 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:57.665968 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c5fb2b06-3d62-4d9a-a486-32686f4d0cf9 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:57.665968 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c5fb2b06-3d62-4d9a-a486-32686f4d0cf9 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:57.665968 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c5fb2b06-3d62-4d9a-a486-32686f4d0cf9 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:57.686862 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-c5fb2b06-3d62-4d9a-a486-32686f4d0cf9 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043066 Jun 23 11:50:57.687438 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 356/745] 10.222.0.13 () {58 vars in 1301 bytes} [Thu Jun 23 11:50:57 2022] GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 11:50:57.744196 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-50deff42-27dd-4afb-a8bc-d409ab56bcf4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:57.744668 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-50deff42-27dd-4afb-a8bc-d409ab56bcf4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 250e2ce6-70ad-4082-8073-6a9cea0ca1e4] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:57.750805 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-50deff42-27dd-4afb-a8bc-d409ab56bcf4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:57.751253 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-50deff42-27dd-4afb-a8bc-d409ab56bcf4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:57.752010 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-50deff42-27dd-4afb-a8bc-d409ab56bcf4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:57.752451 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-50deff42-27dd-4afb-a8bc-d409ab56bcf4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:57.776333 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-50deff42-27dd-4afb-a8bc-d409ab56bcf4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 250e2ce6-70ad-4082-8073-6a9cea0ca1e4] Going to try to terminate instance {{(pid=124670) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 11:50:57.788253 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-a7d4525b-d93b-45af-8078-7c0863199749 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:57.788861 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-a7d4525b-d93b-45af-8078-7c0863199749 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] [instance: c026366c-311a-45eb-899c-30703cd7eb1d] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:57.795450 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-a7d4525b-d93b-45af-8078-7c0863199749 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:57.795901 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-a7d4525b-d93b-45af-8078-7c0863199749 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:57.796655 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-a7d4525b-d93b-45af-8078-7c0863199749 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:57.797089 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-a7d4525b-d93b-45af-8078-7c0863199749 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:57.925905 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-a7d4525b-d93b-45af-8078-7c0863199749 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626c3dbdc0f1407db82d6988e68e40b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce01d9a78d3f4bb7b101b47548b73037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:57.933441 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-a7d4525b-d93b-45af-8078-7c0863199749 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] 10.222.0.13 "GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d" status: 200 len: 1562 microversion: 2.1 time: 0.148986 Jun 23 11:50:57.934081 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 357/746] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:50:57 2022] GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d => generated 1562 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:50:58.068208 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-50deff42-27dd-4afb-a8bc-d409ab56bcf4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "DELETE /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4" status: 204 len: 0 microversion: 2.1 time: 0.327556 Jun 23 11:50:58.068796 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 390/747] 10.222.0.13 () {58 vars in 1238 bytes} [Thu Jun 23 11:50:57 2022] DELETE /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 11:50:58.077923 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-20937758-311b-4bbe-9400-17c5803d55df tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:58.078548 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-20937758-311b-4bbe-9400-17c5803d55df tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 250e2ce6-70ad-4082-8073-6a9cea0ca1e4] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:58.084669 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-20937758-311b-4bbe-9400-17c5803d55df tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:58.085116 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-20937758-311b-4bbe-9400-17c5803d55df tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:58.085865 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-20937758-311b-4bbe-9400-17c5803d55df tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:58.086298 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-20937758-311b-4bbe-9400-17c5803d55df tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:58.224564 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-20937758-311b-4bbe-9400-17c5803d55df tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:58.232251 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-20937758-311b-4bbe-9400-17c5803d55df tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4" status: 200 len: 1682 microversion: 2.1 time: 0.159072 Jun 23 11:50:58.232972 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 358/748] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:50:58 2022] GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4 => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:50:59.249824 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-5e1cdc85-aa9f-4d5d-b359-78eb31e2df6c tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:50:59.250442 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-5e1cdc85-aa9f-4d5d-b359-78eb31e2df6c tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 250e2ce6-70ad-4082-8073-6a9cea0ca1e4] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:50:59.256520 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-5e1cdc85-aa9f-4d5d-b359-78eb31e2df6c tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:59.257397 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-5e1cdc85-aa9f-4d5d-b359-78eb31e2df6c tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:59.257732 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-5e1cdc85-aa9f-4d5d-b359-78eb31e2df6c tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:59.258163 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-5e1cdc85-aa9f-4d5d-b359-78eb31e2df6c tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:59.393116 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-5e1cdc85-aa9f-4d5d-b359-78eb31e2df6c tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:50:59.400634 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-5e1cdc85-aa9f-4d5d-b359-78eb31e2df6c tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4" status: 200 len: 1682 microversion: 2.1 time: 0.155190 Jun 23 11:50:59.401198 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 391/749] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:50:59 2022] GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:50:59.802072 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [req-7c1b8825-c269-45d9-931f-517b0e9122b5 req-78db4eb8-07e8-48c8-b639-9f759fa09d7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "250e2ce6-70ad-4082-8073-6a9cea0ca1e4", "name": "network-vif-deleted", "tag": "acf9b9ee-0912-476a-bbae-a8fa23161cdb"}]} {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:50:59.814119 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [req-7c1b8825-c269-45d9-931f-517b0e9122b5 req-78db4eb8-07e8-48c8-b639-9f759fa09d7c service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:50:59.814581 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [req-7c1b8825-c269-45d9-931f-517b0e9122b5 req-78db4eb8-07e8-48c8-b639-9f759fa09d7c service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:50:59.827096 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.compute.server_external_events [req-7c1b8825-c269-45d9-931f-517b0e9122b5 req-78db4eb8-07e8-48c8-b639-9f759fa09d7c service nova] Creating event network-vif-deleted:acf9b9ee-0912-476a-bbae-a8fa23161cdb for instance 250e2ce6-70ad-4082-8073-6a9cea0ca1e4 on hv-cinder-82099 Jun 23 11:50:59.832083 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [req-7c1b8825-c269-45d9-931f-517b0e9122b5 req-78db4eb8-07e8-48c8-b639-9f759fa09d7c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033865 Jun 23 11:50:59.832694 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 359/750] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:50:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:51:00.418813 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-3e2bacad-8bf5-43f3-b194-6530a8c2ef68 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:51:00.420098 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-3e2bacad-8bf5-43f3-b194-6530a8c2ef68 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 250e2ce6-70ad-4082-8073-6a9cea0ca1e4] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:51:00.426710 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-3e2bacad-8bf5-43f3-b194-6530a8c2ef68 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:00.427154 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-3e2bacad-8bf5-43f3-b194-6530a8c2ef68 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:00.427921 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-3e2bacad-8bf5-43f3-b194-6530a8c2ef68 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:00.428352 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-3e2bacad-8bf5-43f3-b194-6530a8c2ef68 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:00.461093 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-3e2bacad-8bf5-43f3-b194-6530a8c2ef68 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:00.461534 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-3e2bacad-8bf5-43f3-b194-6530a8c2ef68 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:00.461989 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.objects.instance [None req-3e2bacad-8bf5-43f3-b194-6530a8c2ef68 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lazy-loading 'fault' on Instance uuid 250e2ce6-70ad-4082-8073-6a9cea0ca1e4 {{(pid=124670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:51:00.504371 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-3e2bacad-8bf5-43f3-b194-6530a8c2ef68 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:51:00.511957 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-3e2bacad-8bf5-43f3-b194-6530a8c2ef68 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4" status: 200 len: 1332 microversion: 2.1 time: 0.097066 Jun 23 11:51:00.512514 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 392/751] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:51:00 2022] GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4 => generated 1332 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:51:01.531474 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-40736840-68d9-483d-9bc4-fdb2b398c399 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:51:01.532183 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-40736840-68d9-483d-9bc4-fdb2b398c399 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 250e2ce6-70ad-4082-8073-6a9cea0ca1e4] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:51:01.538343 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-40736840-68d9-483d-9bc4-fdb2b398c399 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:01.538833 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-40736840-68d9-483d-9bc4-fdb2b398c399 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:01.539592 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-40736840-68d9-483d-9bc4-fdb2b398c399 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:01.540031 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-40736840-68d9-483d-9bc4-fdb2b398c399 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:01.553911 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.wsgi [None req-40736840-68d9-483d-9bc4-fdb2b398c399 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] HTTP exception thrown: Instance 250e2ce6-70ad-4082-8073-6a9cea0ca1e4 could not be found. Jun 23 11:51:01.555565 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-40736840-68d9-483d-9bc4-fdb2b398c399 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Request method failure captured: Jun 23 11:51:01.555565 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: request: GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4 HTTP/1.1 Jun 23 11:51:01.555565 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Accept: application/json Jun 23 11:51:01.555565 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Accept-Encoding: identity Jun 23 11:51:01.555565 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Connection: close Jun 23 11:51:01.555565 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Content-Length: 0 Jun 23 11:51:01.555565 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Content-Type: application/json Jun 23 11:51:01.555565 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Host: 10.222.0.13 Jun 23 11:51:01.555565 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Openstack-System-Scope: None Jun 23 11:51:01.555565 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: User-Agent: python-urllib3/1.26.9 Jun 23 11:51:01.555565 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Auth-Token: gAAAAABitFIKMke7vIBbvXT2RfPc-4frmGbwTZtMddIa6SPtgPblRzRqc8HMry6yk8WPdy-omEmS4IGKEBZ0krkMZ2AKKZ3XIi6QwXYCvuOyoif5_u-lfFNTFOpNeH9m810_qoSsO3823Vbqo3_NJM0PRtSxfQcTjP265INpx0gWYDOG-d8IrtY Jun 23 11:51:01.555565 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Domain-Id: None Jun 23 11:51:01.555565 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Domain-Name: None Jun 23 11:51:01.555565 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Identity-Status: Confirmed Jun 23 11:51:01.555565 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Is-Admin-Project: True Jun 23 11:51:01.555565 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Domain-Id: default Jun 23 11:51:01.555565 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Domain-Name: Default Jun 23 11:51:01.555565 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Id: ee135767dfc846469d64b658372994a8 Jun 23 11:51:01.555565 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Name: tempest-AttachVolumeNegativeTest-213077295 Jun 23 11:51:01.555565 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Role: member,reader Jun 23 11:51:01.555565 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Roles: member,reader Jun 23 11:51:01.556870 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ee135767dfc846469d64b658372994a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ee135767dfc846469d64b658372994a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ee135767dfc846469d64b658372994a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ee135767dfc846469d64b658372994a8"}]}] Jun 23 11:51:01.556870 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant: tempest-AttachVolumeNegativeTest-213077295 Jun 23 11:51:01.556870 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant-Id: ee135767dfc846469d64b658372994a8 Jun 23 11:51:01.556870 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-213077295 Jun 23 11:51:01.556870 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User: tempest-AttachVolumeNegativeTest-213077295-project Jun 23 11:51:01.556870 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Domain-Id: default Jun 23 11:51:01.556870 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Domain-Name: Default Jun 23 11:51:01.556870 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Id: b7fd8323d29d445f903e2103453e8ae6 Jun 23 11:51:01.556870 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Name: tempest-AttachVolumeNegativeTest-213077295-project Jun 23 11:51:01.556870 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: method: > Jun 23 11:51:01.556870 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: exception: Instance 250e2ce6-70ad-4082-8073-6a9cea0ca1e4 could not be found. Jun 23 11:51:01.556870 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: action_args: {'id': '250e2ce6-70ad-4082-8073-6a9cea0ca1e4'} Jun 23 11:51:01.557599 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:51:01.557599 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:51:01.557599 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:51:01.557599 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:51:01.557599 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:51:01.557599 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:51:01.557599 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:51:01.557599 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:51:01.557599 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:51:01.557599 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:51:01.557599 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 250e2ce6-70ad-4082-8073-6a9cea0ca1e4 could not be found. Jun 23 11:51:01.557599 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:51:01.557599 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:51:01.557599 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:51:01.557599 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:51:01.557599 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:51:01.557599 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:51:01.557599 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:51:01.557599 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:51:01.557599 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:51:01.559275 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:51:01.559275 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 11:51:01.559275 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 11:51:01.559275 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:51:01.559275 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:51:01.559275 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:51:01.559275 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:51:01.559275 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 250e2ce6-70ad-4082-8073-6a9cea0ca1e4 could not be found. Jun 23 11:51:01.559275 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:51:01.559275 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:51:01.559275 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:51:01.559275 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:51:01.559275 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:51:01.559275 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:51:01.559275 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:51:01.559275 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:51:01.559275 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 250e2ce6-70ad-4082-8073-6a9cea0ca1e4 could not be found. Jun 23 11:51:01.559275 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:51:01.561481 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-40736840-68d9-483d-9bc4-fdb2b398c399 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Returning 404 to user: Instance 250e2ce6-70ad-4082-8073-6a9cea0ca1e4 could not be found. {{(pid=124669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:51:01.561481 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-40736840-68d9-483d-9bc4-fdb2b398c399 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4" status: 404 len: 111 microversion: 2.1 time: 0.030932 Jun 23 11:51:01.561481 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 360/752] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:51:01 2022] GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:51:01.565898 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-5b3d245d-f228-46c9-9e5c-4f87bd77e168 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '.version_select at 0x7f5d067e54c0>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:51:01.646777 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-5b3d245d-f228-46c9-9e5c-4f87bd77e168 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1694173493" status: 202 len: 0 microversion: 2.1 time: 0.084527 Jun 23 11:51:01.647352 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 393/753] 10.222.0.13 () {58 vars in 1220 bytes} [Thu Jun 23 11:51:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1694173493 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 11:51:02.659542 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-c2cafbe7-978c-416b-bbed-bcc0150e680d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Action: 'create', calling method: .version_select at 0x7f5d064f21f0>, body: {"keypair": {"name": "tempest-keypair-112440455", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKaWCLiGRvDDKc0KpNIbawn9DUk+zs0sA/2COTOZvmDOZ/NPMpxv/E73xRvHuKSI4RgXwwVfwt/z4NgqrA4i1up+0q07udDQCg8fufnfi1i2hyNool1Pv8u3Zzs8iDIVZQ=="}} {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:51:02.674363 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.quota [None req-c2cafbe7-978c-416b-bbed-bcc0150e680d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Getting quotas for project ee135767dfc846469d64b658372994a8. Resources: {'key_pairs'} {{(pid=124669) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:51:02.678319 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.quota [None req-c2cafbe7-978c-416b-bbed-bcc0150e680d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Getting quotas for user b7fd8323d29d445f903e2103453e8ae6 and project ee135767dfc846469d64b658372994a8. Resources: {'key_pairs'} {{(pid=124669) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:51:02.743898 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-c2cafbe7-978c-416b-bbed-bcc0150e680d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.088263 Jun 23 11:51:02.744488 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 361/754] 10.222.0.13 () {60 vars in 1158 bytes} [Thu Jun 23 11:51:02 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:51:04.813753 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-644aa243-0ce0-4090-9c61-dd9ad1d45988 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-993112745", "imageRef": "b19d6f23-214c-4432-bee6-455978023759", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1be91f97-511d-47dc-890a-297123afd9f6"}], "security_groups": [{"name": "tempest-securitygroup--757610837"}], "key_name": "tempest-keypair-112440455", "user_data": "}} {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:51:04.920849 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.network.neutron [None req-644aa243-0ce0-4090-9c61-dd9ad1d45988 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] validate_networks() for [('1be91f97-511d-47dc-890a-297123afd9f6', None, None, None, None, None)] {{(pid=124670) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 11:51:05.279952 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.virt.hardware [None req-644aa243-0ce0-4090-9c61-dd9ad1d45988 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Flavor limits 0:0:0 {{(pid=124670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 11:51:05.280401 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.virt.hardware [None req-644aa243-0ce0-4090-9c61-dd9ad1d45988 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Image limits 0:0:0 {{(pid=124670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 11:51:05.280883 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.virt.hardware [None req-644aa243-0ce0-4090-9c61-dd9ad1d45988 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Flavor pref 0:0:0 {{(pid=124670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 11:51:05.281293 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.virt.hardware [None req-644aa243-0ce0-4090-9c61-dd9ad1d45988 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Image pref 0:0:0 {{(pid=124670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 11:51:05.281716 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.virt.hardware [None req-644aa243-0ce0-4090-9c61-dd9ad1d45988 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 11:51:05.290462 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-644aa243-0ce0-4090-9c61-dd9ad1d45988 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:05.290936 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-644aa243-0ce0-4090-9c61-dd9ad1d45988 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:05.291725 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-644aa243-0ce0-4090-9c61-dd9ad1d45988 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:05.292250 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-644aa243-0ce0-4090-9c61-dd9ad1d45988 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:05.308986 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.quota [None req-644aa243-0ce0-4090-9c61-dd9ad1d45988 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Getting quotas for project ee135767dfc846469d64b658372994a8. Resources: {'cores', 'instances', 'ram'} {{(pid=124670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:51:05.313045 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.quota [None req-644aa243-0ce0-4090-9c61-dd9ad1d45988 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Getting quotas for user b7fd8323d29d445f903e2103453e8ae6 and project ee135767dfc846469d64b658372994a8. Resources: {'cores', 'instances', 'ram'} {{(pid=124670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:51:05.323685 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-644aa243-0ce0-4090-9c61-dd9ad1d45988 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Going to run 1 instances... {{(pid=124670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 11:51:05.326256 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-644aa243-0ce0-4090-9c61-dd9ad1d45988 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 284456f6-2347-46c7-bec1-2acb170b7421] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b19d6f23-214c-4432-bee6-455978023759',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 11:51:05.452813 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-644aa243-0ce0-4090-9c61-dd9ad1d45988 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.644614 Jun 23 11:51:05.453379 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 394/755] 10.222.0.13 () {60 vars in 1146 bytes} [Thu Jun 23 11:51:04 2022] POST /compute/v2.1/servers => generated 401 bytes in 646 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 11:51:05.463910 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-a55e7154-7d4b-4572-9b5f-d60c317bee68 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:51:05.464532 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-a55e7154-7d4b-4572-9b5f-d60c317bee68 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 284456f6-2347-46c7-bec1-2acb170b7421] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:51:05.518341 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-a55e7154-7d4b-4572-9b5f-d60c317bee68 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:51:05.524981 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-a55e7154-7d4b-4572-9b5f-d60c317bee68 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/284456f6-2347-46c7-bec1-2acb170b7421" status: 200 len: 1240 microversion: 2.1 time: 0.065457 Jun 23 11:51:05.525681 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 362/756] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:51:05 2022] GET /compute/v2.1/servers/284456f6-2347-46c7-bec1-2acb170b7421 => generated 1240 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:51:06.543018 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-74292f90-c6cd-49c2-8a11-a48b1a0985ab tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:51:06.543639 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-74292f90-c6cd-49c2-8a11-a48b1a0985ab tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 284456f6-2347-46c7-bec1-2acb170b7421] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:51:06.550376 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-74292f90-c6cd-49c2-8a11-a48b1a0985ab tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:06.550864 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-74292f90-c6cd-49c2-8a11-a48b1a0985ab tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:06.551627 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-74292f90-c6cd-49c2-8a11-a48b1a0985ab tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:06.552086 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-74292f90-c6cd-49c2-8a11-a48b1a0985ab tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:06.612991 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-74292f90-c6cd-49c2-8a11-a48b1a0985ab tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:51:06.620300 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-74292f90-c6cd-49c2-8a11-a48b1a0985ab tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/284456f6-2347-46c7-bec1-2acb170b7421" status: 200 len: 1244 microversion: 2.1 time: 0.081376 Jun 23 11:51:06.620854 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 395/757] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:51:06 2022] GET /compute/v2.1/servers/284456f6-2347-46c7-bec1-2acb170b7421 => generated 1244 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:51:07.637140 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-a6e0c1d4-a8d8-4661-bc2e-b4fc20787e7b tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:51:07.637756 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-a6e0c1d4-a8d8-4661-bc2e-b4fc20787e7b tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 284456f6-2347-46c7-bec1-2acb170b7421] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:51:07.644932 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-a6e0c1d4-a8d8-4661-bc2e-b4fc20787e7b tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:07.645379 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-a6e0c1d4-a8d8-4661-bc2e-b4fc20787e7b tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:07.646144 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-a6e0c1d4-a8d8-4661-bc2e-b4fc20787e7b tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:07.646694 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-a6e0c1d4-a8d8-4661-bc2e-b4fc20787e7b tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:07.708268 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-a6e0c1d4-a8d8-4661-bc2e-b4fc20787e7b tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:51:07.715790 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-a6e0c1d4-a8d8-4661-bc2e-b4fc20787e7b tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/284456f6-2347-46c7-bec1-2acb170b7421" status: 200 len: 1310 microversion: 2.1 time: 0.082490 Jun 23 11:51:07.716623 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 363/758] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:51:07 2022] GET /compute/v2.1/servers/284456f6-2347-46c7-bec1-2acb170b7421 => generated 1310 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:51:08.733703 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-9cb42593-66ad-4065-a9a2-8bebc7611a80 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:51:08.734318 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-9cb42593-66ad-4065-a9a2-8bebc7611a80 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 284456f6-2347-46c7-bec1-2acb170b7421] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:51:08.740379 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-9cb42593-66ad-4065-a9a2-8bebc7611a80 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:08.740824 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-9cb42593-66ad-4065-a9a2-8bebc7611a80 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:08.741570 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-9cb42593-66ad-4065-a9a2-8bebc7611a80 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:08.741999 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-9cb42593-66ad-4065-a9a2-8bebc7611a80 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:08.881725 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-9cb42593-66ad-4065-a9a2-8bebc7611a80 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:51:08.891360 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-9cb42593-66ad-4065-a9a2-8bebc7611a80 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/284456f6-2347-46c7-bec1-2acb170b7421" status: 200 len: 1365 microversion: 2.1 time: 0.161991 Jun 23 11:51:08.894347 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 396/759] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:51:08 2022] GET /compute/v2.1/servers/284456f6-2347-46c7-bec1-2acb170b7421 => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:51:09.091789 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [req-b6bf8d4c-3139-4f1f-adbd-99f1e4e2a8e5 req-7496788d-11d4-4a8e-9924-65ed88b17c47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "284456f6-2347-46c7-bec1-2acb170b7421", "tag": "22516136-8ac5-4a18-ba8f-bc1b5f85a4dd"}]} {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:51:09.101745 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [req-b6bf8d4c-3139-4f1f-adbd-99f1e4e2a8e5 req-7496788d-11d4-4a8e-9924-65ed88b17c47 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:09.102274 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [req-b6bf8d4c-3139-4f1f-adbd-99f1e4e2a8e5 req-7496788d-11d4-4a8e-9924-65ed88b17c47 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:09.114656 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.compute.server_external_events [req-b6bf8d4c-3139-4f1f-adbd-99f1e4e2a8e5 req-7496788d-11d4-4a8e-9924-65ed88b17c47 service nova] Creating event network-changed:22516136-8ac5-4a18-ba8f-bc1b5f85a4dd for instance 284456f6-2347-46c7-bec1-2acb170b7421 on hv-cinder-82099 Jun 23 11:51:09.120063 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [req-b6bf8d4c-3139-4f1f-adbd-99f1e4e2a8e5 req-7496788d-11d4-4a8e-9924-65ed88b17c47 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031864 Jun 23 11:51:09.120660 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 364/760] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:51:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:51:09.909890 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-345e553c-ad4e-47e9-b4b7-90d7e9d12528 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:51:09.910506 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-345e553c-ad4e-47e9-b4b7-90d7e9d12528 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 284456f6-2347-46c7-bec1-2acb170b7421] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:51:09.916653 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-345e553c-ad4e-47e9-b4b7-90d7e9d12528 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:09.917095 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-345e553c-ad4e-47e9-b4b7-90d7e9d12528 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:09.917846 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-345e553c-ad4e-47e9-b4b7-90d7e9d12528 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:09.918275 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-345e553c-ad4e-47e9-b4b7-90d7e9d12528 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:10.055078 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-345e553c-ad4e-47e9-b4b7-90d7e9d12528 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:51:10.063058 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-345e553c-ad4e-47e9-b4b7-90d7e9d12528 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/284456f6-2347-46c7-bec1-2acb170b7421" status: 200 len: 1365 microversion: 2.1 time: 0.158532 Jun 23 11:51:10.063608 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 397/761] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:51:09 2022] GET /compute/v2.1/servers/284456f6-2347-46c7-bec1-2acb170b7421 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:51:11.081313 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-d6f4959c-dd0b-4486-90c2-538c73032cd6 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:51:11.082014 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-d6f4959c-dd0b-4486-90c2-538c73032cd6 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 284456f6-2347-46c7-bec1-2acb170b7421] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:51:11.088242 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-d6f4959c-dd0b-4486-90c2-538c73032cd6 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:11.088694 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-d6f4959c-dd0b-4486-90c2-538c73032cd6 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:11.089449 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-d6f4959c-dd0b-4486-90c2-538c73032cd6 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:11.089885 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-d6f4959c-dd0b-4486-90c2-538c73032cd6 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:11.158013 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-def03e91-b6a7-42bd-b48e-97e865f76e80 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:51:11.158581 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-def03e91-b6a7-42bd-b48e-97e865f76e80 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] [instance: 230c27ca-dfe2-4a74-aca7-106c1e5af8fc] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:51:11.164716 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-def03e91-b6a7-42bd-b48e-97e865f76e80 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:11.165435 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-def03e91-b6a7-42bd-b48e-97e865f76e80 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:11.166211 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-def03e91-b6a7-42bd-b48e-97e865f76e80 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:11.166678 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-def03e91-b6a7-42bd-b48e-97e865f76e80 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:11.191705 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-def03e91-b6a7-42bd-b48e-97e865f76e80 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] [instance: 230c27ca-dfe2-4a74-aca7-106c1e5af8fc] Going to try to terminate instance {{(pid=124670) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 11:51:11.225117 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:51:11.227997 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-d6f4959c-dd0b-4486-90c2-538c73032cd6 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:51:11.235993 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-d6f4959c-dd0b-4486-90c2-538c73032cd6 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/284456f6-2347-46c7-bec1-2acb170b7421" status: 200 len: 1365 microversion: 2.1 time: 0.159773 Jun 23 11:51:11.236567 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 365/762] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:51:11 2022] GET /compute/v2.1/servers/284456f6-2347-46c7-bec1-2acb170b7421 => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:51:11.502702 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-def03e91-b6a7-42bd-b48e-97e865f76e80 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] 10.222.0.13 "DELETE /compute/v2.1/servers/230c27ca-dfe2-4a74-aca7-106c1e5af8fc" status: 204 len: 0 microversion: 2.1 time: 0.349151 Jun 23 11:51:11.503289 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 398/763] 10.222.0.13 () {58 vars in 1238 bytes} [Thu Jun 23 11:51:11 2022] DELETE /compute/v2.1/servers/230c27ca-dfe2-4a74-aca7-106c1e5af8fc => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 23 11:51:11.511429 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-d26c25c1-088e-47c8-b185-d3353297902c tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:51:11.512069 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-d26c25c1-088e-47c8-b185-d3353297902c tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] [instance: 230c27ca-dfe2-4a74-aca7-106c1e5af8fc] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:51:11.518907 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-d26c25c1-088e-47c8-b185-d3353297902c tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:11.519360 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-d26c25c1-088e-47c8-b185-d3353297902c tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:11.520148 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-d26c25c1-088e-47c8-b185-d3353297902c tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:11.520605 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-d26c25c1-088e-47c8-b185-d3353297902c tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:11.649178 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-d26c25c1-088e-47c8-b185-d3353297902c tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc5a4676f6a416cbdc8c67ebd80cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e810a9bc3b44c4aa8ca2ddd0fa68f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:51:11.652721 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:51:11.657832 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-d26c25c1-088e-47c8-b185-d3353297902c tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] 10.222.0.13 "GET /compute/v2.1/servers/230c27ca-dfe2-4a74-aca7-106c1e5af8fc" status: 200 len: 1576 microversion: 2.1 time: 0.150261 Jun 23 11:51:11.658393 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 366/764] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:51:11 2022] GET /compute/v2.1/servers/230c27ca-dfe2-4a74-aca7-106c1e5af8fc => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:51:12.253606 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-dc3b205f-fec0-4dcb-a94a-46b6c448b615 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:51:12.254310 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-dc3b205f-fec0-4dcb-a94a-46b6c448b615 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 284456f6-2347-46c7-bec1-2acb170b7421] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:51:12.260370 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-dc3b205f-fec0-4dcb-a94a-46b6c448b615 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:12.260817 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-dc3b205f-fec0-4dcb-a94a-46b6c448b615 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:12.261574 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-dc3b205f-fec0-4dcb-a94a-46b6c448b615 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:12.262007 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-dc3b205f-fec0-4dcb-a94a-46b6c448b615 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:12.390986 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-dc3b205f-fec0-4dcb-a94a-46b6c448b615 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:51:12.398336 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-dc3b205f-fec0-4dcb-a94a-46b6c448b615 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/284456f6-2347-46c7-bec1-2acb170b7421" status: 200 len: 1365 microversion: 2.1 time: 0.148905 Jun 23 11:51:12.398923 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 399/765] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:51:12 2022] GET /compute/v2.1/servers/284456f6-2347-46c7-bec1-2acb170b7421 => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:51:12.676099 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-acb97374-4802-4e4a-b3fa-34a8bf3c0279 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:51:12.676712 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-acb97374-4802-4e4a-b3fa-34a8bf3c0279 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] [instance: 230c27ca-dfe2-4a74-aca7-106c1e5af8fc] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:51:12.679388 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:51:12.684613 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-acb97374-4802-4e4a-b3fa-34a8bf3c0279 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:12.685058 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-acb97374-4802-4e4a-b3fa-34a8bf3c0279 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:12.685817 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-acb97374-4802-4e4a-b3fa-34a8bf3c0279 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:12.687227 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-acb97374-4802-4e4a-b3fa-34a8bf3c0279 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:12.817487 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-acb97374-4802-4e4a-b3fa-34a8bf3c0279 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc5a4676f6a416cbdc8c67ebd80cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e810a9bc3b44c4aa8ca2ddd0fa68f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:51:12.824979 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-acb97374-4802-4e4a-b3fa-34a8bf3c0279 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] 10.222.0.13 "GET /compute/v2.1/servers/230c27ca-dfe2-4a74-aca7-106c1e5af8fc" status: 200 len: 1576 microversion: 2.1 time: 0.153103 Jun 23 11:51:12.825541 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 367/766] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:51:12 2022] GET /compute/v2.1/servers/230c27ca-dfe2-4a74-aca7-106c1e5af8fc => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:51:13.415790 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-79a7656f-b888-4d77-bde5-da3b1acd8f54 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:51:13.416400 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-79a7656f-b888-4d77-bde5-da3b1acd8f54 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 284456f6-2347-46c7-bec1-2acb170b7421] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:51:13.418384 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:51:13.424011 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-79a7656f-b888-4d77-bde5-da3b1acd8f54 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:13.424462 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-79a7656f-b888-4d77-bde5-da3b1acd8f54 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:13.425221 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-79a7656f-b888-4d77-bde5-da3b1acd8f54 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:13.425660 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-79a7656f-b888-4d77-bde5-da3b1acd8f54 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:13.560512 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-79a7656f-b888-4d77-bde5-da3b1acd8f54 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:51:13.567796 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-79a7656f-b888-4d77-bde5-da3b1acd8f54 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/284456f6-2347-46c7-bec1-2acb170b7421" status: 200 len: 1365 microversion: 2.1 time: 0.155797 Jun 23 11:51:13.568364 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 400/767] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:51:13 2022] GET /compute/v2.1/servers/284456f6-2347-46c7-bec1-2acb170b7421 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:51:13.842592 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-0edbc9b3-9b19-4396-8c96-a9985a3bf625 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:51:13.843351 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-0edbc9b3-9b19-4396-8c96-a9985a3bf625 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] [instance: 230c27ca-dfe2-4a74-aca7-106c1e5af8fc] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:51:13.851772 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-0edbc9b3-9b19-4396-8c96-a9985a3bf625 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:13.852223 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-0edbc9b3-9b19-4396-8c96-a9985a3bf625 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:13.852975 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-0edbc9b3-9b19-4396-8c96-a9985a3bf625 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:13.853409 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-0edbc9b3-9b19-4396-8c96-a9985a3bf625 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:13.985912 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-0edbc9b3-9b19-4396-8c96-a9985a3bf625 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc5a4676f6a416cbdc8c67ebd80cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e810a9bc3b44c4aa8ca2ddd0fa68f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:51:13.993413 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-0edbc9b3-9b19-4396-8c96-a9985a3bf625 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] 10.222.0.13 "GET /compute/v2.1/servers/230c27ca-dfe2-4a74-aca7-106c1e5af8fc" status: 200 len: 1576 microversion: 2.1 time: 0.154692 Jun 23 11:51:13.993972 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 368/768] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:51:13 2022] GET /compute/v2.1/servers/230c27ca-dfe2-4a74-aca7-106c1e5af8fc => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:51:14.585832 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-4f3de3ba-d88f-4dc4-9ab6-f966a3bc84af tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:51:14.586445 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-4f3de3ba-d88f-4dc4-9ab6-f966a3bc84af tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 284456f6-2347-46c7-bec1-2acb170b7421] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:51:14.592532 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-4f3de3ba-d88f-4dc4-9ab6-f966a3bc84af tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:14.592982 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-4f3de3ba-d88f-4dc4-9ab6-f966a3bc84af tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:14.593736 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-4f3de3ba-d88f-4dc4-9ab6-f966a3bc84af tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:14.594169 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-4f3de3ba-d88f-4dc4-9ab6-f966a3bc84af tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:14.725433 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-4f3de3ba-d88f-4dc4-9ab6-f966a3bc84af tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:51:14.733602 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-4f3de3ba-d88f-4dc4-9ab6-f966a3bc84af tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/284456f6-2347-46c7-bec1-2acb170b7421" status: 200 len: 1365 microversion: 2.1 time: 0.150978 Jun 23 11:51:14.734168 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 401/769] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:51:14 2022] GET /compute/v2.1/servers/284456f6-2347-46c7-bec1-2acb170b7421 => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:51:15.011745 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-ae49ead5-58e7-4804-8d94-a5a8da4afc14 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:51:15.012357 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-ae49ead5-58e7-4804-8d94-a5a8da4afc14 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] [instance: 230c27ca-dfe2-4a74-aca7-106c1e5af8fc] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:51:15.019017 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ae49ead5-58e7-4804-8d94-a5a8da4afc14 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:15.019471 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ae49ead5-58e7-4804-8d94-a5a8da4afc14 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:15.020235 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ae49ead5-58e7-4804-8d94-a5a8da4afc14 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:15.020680 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ae49ead5-58e7-4804-8d94-a5a8da4afc14 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:15.154612 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-ae49ead5-58e7-4804-8d94-a5a8da4afc14 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc5a4676f6a416cbdc8c67ebd80cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e810a9bc3b44c4aa8ca2ddd0fa68f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:51:15.162178 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-ae49ead5-58e7-4804-8d94-a5a8da4afc14 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] 10.222.0.13 "GET /compute/v2.1/servers/230c27ca-dfe2-4a74-aca7-106c1e5af8fc" status: 200 len: 1576 microversion: 2.1 time: 0.155620 Jun 23 11:51:15.162783 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 369/770] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:51:15 2022] GET /compute/v2.1/servers/230c27ca-dfe2-4a74-aca7-106c1e5af8fc => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:51:15.496461 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [req-fa66d389-99b3-4444-adda-abb83fc5bfb2 req-af0379ca-04cb-4dd4-bbe3-f7715b72f953 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "230c27ca-dfe2-4a74-aca7-106c1e5af8fc", "name": "network-vif-deleted", "tag": "22ef1251-f87b-4a4f-9c86-55c2036a4cdc"}]} {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:51:15.501612 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_cell0:SELECT=2 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:51:15.502672 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_cell0:SELECT=6 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:51:15.506614 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-fa66d389-99b3-4444-adda-abb83fc5bfb2 req-af0379ca-04cb-4dd4-bbe3-f7715b72f953 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:15.507053 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-fa66d389-99b3-4444-adda-abb83fc5bfb2 req-af0379ca-04cb-4dd4-bbe3-f7715b72f953 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:15.518827 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.compute.server_external_events [req-fa66d389-99b3-4444-adda-abb83fc5bfb2 req-af0379ca-04cb-4dd4-bbe3-f7715b72f953 service nova] Creating event network-vif-deleted:22ef1251-f87b-4a4f-9c86-55c2036a4cdc for instance 230c27ca-dfe2-4a74-aca7-106c1e5af8fc on hv-cinder-82099 Jun 23 11:51:15.524009 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [req-fa66d389-99b3-4444-adda-abb83fc5bfb2 req-af0379ca-04cb-4dd4-bbe3-f7715b72f953 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032068 Jun 23 11:51:15.542282 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 402/771] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:51:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:51:15.750957 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-da5d82e1-218c-472f-8262-2b9ed1296bce tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:51:15.751874 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-da5d82e1-218c-472f-8262-2b9ed1296bce tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 284456f6-2347-46c7-bec1-2acb170b7421] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:51:15.753697 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_cell0:SELECT=6 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:51:15.758551 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-da5d82e1-218c-472f-8262-2b9ed1296bce tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:15.759051 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-da5d82e1-218c-472f-8262-2b9ed1296bce tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:15.759807 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-da5d82e1-218c-472f-8262-2b9ed1296bce tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:15.760241 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-da5d82e1-218c-472f-8262-2b9ed1296bce tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:15.893185 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-da5d82e1-218c-472f-8262-2b9ed1296bce tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:51:15.901014 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-da5d82e1-218c-472f-8262-2b9ed1296bce tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/284456f6-2347-46c7-bec1-2acb170b7421" status: 200 len: 1365 microversion: 2.1 time: 0.154425 Jun 23 11:51:15.901604 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 370/772] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:51:15 2022] GET /compute/v2.1/servers/284456f6-2347-46c7-bec1-2acb170b7421 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:51:16.180999 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-90ee232e-7983-440e-a4e7-d3d9fff42899 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:51:16.182564 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-90ee232e-7983-440e-a4e7-d3d9fff42899 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] [instance: 230c27ca-dfe2-4a74-aca7-106c1e5af8fc] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:51:16.195869 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-90ee232e-7983-440e-a4e7-d3d9fff42899 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:16.202307 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-90ee232e-7983-440e-a4e7-d3d9fff42899 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:16.202307 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-90ee232e-7983-440e-a4e7-d3d9fff42899 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:16.202307 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-90ee232e-7983-440e-a4e7-d3d9fff42899 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:16.298646 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-90ee232e-7983-440e-a4e7-d3d9fff42899 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc5a4676f6a416cbdc8c67ebd80cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e810a9bc3b44c4aa8ca2ddd0fa68f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:51:16.307362 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-90ee232e-7983-440e-a4e7-d3d9fff42899 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] 10.222.0.13 "GET /compute/v2.1/servers/230c27ca-dfe2-4a74-aca7-106c1e5af8fc" status: 200 len: 1224 microversion: 2.1 time: 0.131332 Jun 23 11:51:16.309484 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 403/773] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:51:16 2022] GET /compute/v2.1/servers/230c27ca-dfe2-4a74-aca7-106c1e5af8fc => generated 1224 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:51:16.591510 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [req-e8c973d9-5942-4c14-b9a4-88953798c6e4 req-41ef22c9-f754-4176-9b0d-31d4f8e5fad5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "284456f6-2347-46c7-bec1-2acb170b7421", "name": "network-vif-plugged", "status": "completed", "tag": "22516136-8ac5-4a18-ba8f-bc1b5f85a4dd"}]} {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:51:16.633364 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [req-e8c973d9-5942-4c14-b9a4-88953798c6e4 req-41ef22c9-f754-4176-9b0d-31d4f8e5fad5 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:16.633364 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [req-e8c973d9-5942-4c14-b9a4-88953798c6e4 req-41ef22c9-f754-4176-9b0d-31d4f8e5fad5 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:16.633364 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.compute.server_external_events [req-e8c973d9-5942-4c14-b9a4-88953798c6e4 req-41ef22c9-f754-4176-9b0d-31d4f8e5fad5 service nova] Creating event network-vif-plugged:22516136-8ac5-4a18-ba8f-bc1b5f85a4dd for instance 284456f6-2347-46c7-bec1-2acb170b7421 on hv-cinder-82099 Jun 23 11:51:16.633364 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [req-e8c973d9-5942-4c14-b9a4-88953798c6e4 req-41ef22c9-f754-4176-9b0d-31d4f8e5fad5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030937 Jun 23 11:51:16.633364 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 371/774] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:51:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:51:16.919212 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-e6b9dc08-c1b2-4f3c-ae78-6a388b72cd14 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:51:16.921100 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-e6b9dc08-c1b2-4f3c-ae78-6a388b72cd14 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 284456f6-2347-46c7-bec1-2acb170b7421] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:51:16.926640 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-e6b9dc08-c1b2-4f3c-ae78-6a388b72cd14 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:16.927088 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-e6b9dc08-c1b2-4f3c-ae78-6a388b72cd14 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:16.927899 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-e6b9dc08-c1b2-4f3c-ae78-6a388b72cd14 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:16.928334 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-e6b9dc08-c1b2-4f3c-ae78-6a388b72cd14 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:17.063954 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-e6b9dc08-c1b2-4f3c-ae78-6a388b72cd14 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:51:17.071577 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-e6b9dc08-c1b2-4f3c-ae78-6a388b72cd14 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/284456f6-2347-46c7-bec1-2acb170b7421" status: 200 len: 1365 microversion: 2.1 time: 0.156201 Jun 23 11:51:17.072138 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 404/775] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:51:16 2022] GET /compute/v2.1/servers/284456f6-2347-46c7-bec1-2acb170b7421 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:51:17.325563 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-c87f724b-9c84-4dd6-b232-ef7178352a64 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:51:17.326260 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-c87f724b-9c84-4dd6-b232-ef7178352a64 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] [instance: 230c27ca-dfe2-4a74-aca7-106c1e5af8fc] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:51:17.332763 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c87f724b-9c84-4dd6-b232-ef7178352a64 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:17.333208 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c87f724b-9c84-4dd6-b232-ef7178352a64 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:17.333965 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c87f724b-9c84-4dd6-b232-ef7178352a64 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:17.334401 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c87f724b-9c84-4dd6-b232-ef7178352a64 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:17.348507 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.wsgi [None req-c87f724b-9c84-4dd6-b232-ef7178352a64 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] HTTP exception thrown: Instance 230c27ca-dfe2-4a74-aca7-106c1e5af8fc could not be found. Jun 23 11:51:17.350192 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-c87f724b-9c84-4dd6-b232-ef7178352a64 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Request method failure captured: Jun 23 11:51:17.350192 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: request: GET /compute/v2.1/servers/230c27ca-dfe2-4a74-aca7-106c1e5af8fc HTTP/1.1 Jun 23 11:51:17.350192 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Accept: application/json Jun 23 11:51:17.350192 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Accept-Encoding: identity Jun 23 11:51:17.350192 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Connection: close Jun 23 11:51:17.350192 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Content-Length: 0 Jun 23 11:51:17.350192 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Content-Type: application/json Jun 23 11:51:17.350192 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Host: 10.222.0.13 Jun 23 11:51:17.350192 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Openstack-System-Scope: None Jun 23 11:51:17.350192 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: User-Agent: python-urllib3/1.26.9 Jun 23 11:51:17.350192 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Auth-Token: gAAAAABitFKrXJlGv4Y10nZpBqokawq1fsvWINJ6On9pjTbZcDoDz6HvHtwtJWthsDNegb9YIJput0wiweHEs02NPCmIjRC79du2T88hCpYxuEgvtooi0sBEM-VyipUNCAzHQ0gWdAGR_dUjDy3okf2_2yYQDZguvq9NDjINnrdjdvaf9KiLdeA Jun 23 11:51:17.350192 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Domain-Id: None Jun 23 11:51:17.350192 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Domain-Name: None Jun 23 11:51:17.350192 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Identity-Status: Confirmed Jun 23 11:51:17.350192 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Is-Admin-Project: True Jun 23 11:51:17.350192 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Domain-Id: default Jun 23 11:51:17.350192 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Domain-Name: Default Jun 23 11:51:17.350192 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Id: 2e810a9bc3b44c4aa8ca2ddd0fa68f7b Jun 23 11:51:17.350192 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Name: tempest-TestVolumeBootPattern-220427877 Jun 23 11:51:17.350192 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Role: member,reader Jun 23 11:51:17.350192 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Roles: member,reader Jun 23 11:51:17.351824 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2e810a9bc3b44c4aa8ca2ddd0fa68f7b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2e810a9bc3b44c4aa8ca2ddd0fa68f7b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2e810a9bc3b44c4aa8ca2ddd0fa68f7b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2e810a9bc3b44c4aa8ca2ddd0fa68f7b"}]}] Jun 23 11:51:17.351824 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant: tempest-TestVolumeBootPattern-220427877 Jun 23 11:51:17.351824 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant-Id: 2e810a9bc3b44c4aa8ca2ddd0fa68f7b Jun 23 11:51:17.351824 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant-Name: tempest-TestVolumeBootPattern-220427877 Jun 23 11:51:17.351824 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User: tempest-TestVolumeBootPattern-220427877-project Jun 23 11:51:17.351824 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Domain-Id: default Jun 23 11:51:17.351824 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Domain-Name: Default Jun 23 11:51:17.351824 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Id: 6cc5a4676f6a416cbdc8c67ebd80cdf3 Jun 23 11:51:17.351824 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Name: tempest-TestVolumeBootPattern-220427877-project Jun 23 11:51:17.351824 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: method: > Jun 23 11:51:17.351824 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: exception: Instance 230c27ca-dfe2-4a74-aca7-106c1e5af8fc could not be found. Jun 23 11:51:17.351824 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: action_args: {'id': '230c27ca-dfe2-4a74-aca7-106c1e5af8fc'} Jun 23 11:51:17.352921 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:51:17.352921 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:51:17.352921 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:51:17.352921 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:51:17.352921 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:51:17.352921 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:51:17.352921 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:51:17.352921 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:51:17.352921 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:51:17.352921 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:51:17.352921 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 230c27ca-dfe2-4a74-aca7-106c1e5af8fc could not be found. Jun 23 11:51:17.352921 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:51:17.352921 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:51:17.352921 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:51:17.352921 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:51:17.352921 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:51:17.352921 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:51:17.352921 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:51:17.352921 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:51:17.352921 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:51:17.354375 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:51:17.354375 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 11:51:17.354375 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 11:51:17.354375 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:51:17.354375 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:51:17.354375 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:51:17.354375 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:51:17.354375 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 230c27ca-dfe2-4a74-aca7-106c1e5af8fc could not be found. Jun 23 11:51:17.354375 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:51:17.354375 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:51:17.354375 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:51:17.354375 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:51:17.354375 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:51:17.354375 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:51:17.354375 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:51:17.354375 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:51:17.354375 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 230c27ca-dfe2-4a74-aca7-106c1e5af8fc could not be found. Jun 23 11:51:17.354375 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:51:17.355918 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-c87f724b-9c84-4dd6-b232-ef7178352a64 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Returning 404 to user: Instance 230c27ca-dfe2-4a74-aca7-106c1e5af8fc could not be found. {{(pid=124669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:51:17.355918 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-c87f724b-9c84-4dd6-b232-ef7178352a64 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] 10.222.0.13 "GET /compute/v2.1/servers/230c27ca-dfe2-4a74-aca7-106c1e5af8fc" status: 404 len: 111 microversion: 2.1 time: 0.030250 Jun 23 11:51:17.355918 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 372/776] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:51:17 2022] GET /compute/v2.1/servers/230c27ca-dfe2-4a74-aca7-106c1e5af8fc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:51:17.445302 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-a4a49ff6-aca5-4279-af5c-136aeafc8ecb tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-790442685", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-367548420", "security_groups": [{"name": "tempest-secgroup-smoke-1542660815"}], "block_device_mapping_v2": [{"uuid": "a70c2e27-45af-4f45-9da7-8b11ecbefe99", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "24cad3d6-9999-4d1e-ad9b-006e17356f41"}]}} {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:51:17.555691 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.network.neutron [None req-a4a49ff6-aca5-4279-af5c-136aeafc8ecb tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] validate_networks() for [('24cad3d6-9999-4d1e-ad9b-006e17356f41', None, None, None, None, None)] {{(pid=124670) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 11:51:17.914665 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.virt.hardware [None req-a4a49ff6-aca5-4279-af5c-136aeafc8ecb tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Flavor limits 0:0:0 {{(pid=124670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 11:51:17.915081 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.virt.hardware [None req-a4a49ff6-aca5-4279-af5c-136aeafc8ecb tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Image limits 0:0:0 {{(pid=124670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 11:51:17.915549 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.virt.hardware [None req-a4a49ff6-aca5-4279-af5c-136aeafc8ecb tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Flavor pref 0:0:0 {{(pid=124670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 11:51:17.915945 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.virt.hardware [None req-a4a49ff6-aca5-4279-af5c-136aeafc8ecb tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Image pref 0:0:0 {{(pid=124670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 11:51:17.916423 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.virt.hardware [None req-a4a49ff6-aca5-4279-af5c-136aeafc8ecb tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 11:51:17.925962 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a4a49ff6-aca5-4279-af5c-136aeafc8ecb tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:17.926401 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a4a49ff6-aca5-4279-af5c-136aeafc8ecb tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:17.927215 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a4a49ff6-aca5-4279-af5c-136aeafc8ecb tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:17.927672 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a4a49ff6-aca5-4279-af5c-136aeafc8ecb tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:17.943953 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.quota [None req-a4a49ff6-aca5-4279-af5c-136aeafc8ecb tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Getting quotas for project 2e810a9bc3b44c4aa8ca2ddd0fa68f7b. Resources: {'cores', 'instances', 'ram'} {{(pid=124670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:51:17.947738 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.quota [None req-a4a49ff6-aca5-4279-af5c-136aeafc8ecb tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Getting quotas for user 6cc5a4676f6a416cbdc8c67ebd80cdf3 and project 2e810a9bc3b44c4aa8ca2ddd0fa68f7b. Resources: {'cores', 'instances', 'ram'} {{(pid=124670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:51:18.003889 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-a4a49ff6-aca5-4279-af5c-136aeafc8ecb tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Going to run 1 instances... {{(pid=124670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 11:51:18.005928 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-a4a49ff6-aca5-4279-af5c-136aeafc8ecb tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] [instance: 4da97884-614a-462c-acfd-09b46602e225] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a70c2e27-45af-4f45-9da7-8b11ecbefe99',volume_size=None,volume_type=None)] {{(pid=124670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 11:51:18.089149 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-5acedd1b-ca59-4bc1-ade8-7441c5b3c79d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:51:18.089793 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-5acedd1b-ca59-4bc1-ade8-7441c5b3c79d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 284456f6-2347-46c7-bec1-2acb170b7421] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:51:18.096873 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-5acedd1b-ca59-4bc1-ade8-7441c5b3c79d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:18.097316 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-5acedd1b-ca59-4bc1-ade8-7441c5b3c79d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:18.098190 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-5acedd1b-ca59-4bc1-ade8-7441c5b3c79d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:18.098651 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-5acedd1b-ca59-4bc1-ade8-7441c5b3c79d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:18.230505 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-5acedd1b-ca59-4bc1-ade8-7441c5b3c79d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:51:18.238471 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-5acedd1b-ca59-4bc1-ade8-7441c5b3c79d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/284456f6-2347-46c7-bec1-2acb170b7421" status: 200 len: 1365 microversion: 2.1 time: 0.153130 Jun 23 11:51:18.238965 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 373/777] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:51:18 2022] GET /compute/v2.1/servers/284456f6-2347-46c7-bec1-2acb170b7421 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:51:18.437250 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-a4a49ff6-aca5-4279-af5c-136aeafc8ecb tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.994939 Jun 23 11:51:18.437927 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 405/778] 10.222.0.13 () {60 vars in 1146 bytes} [Thu Jun 23 11:51:17 2022] POST /compute/v2.1/servers => generated 406 bytes in 997 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 11:51:18.447783 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-c33b106d-e1a5-4c46-a5f5-3d1be77e20d3 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:51:18.448405 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-c33b106d-e1a5-4c46-a5f5-3d1be77e20d3 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] [instance: 4da97884-614a-462c-acfd-09b46602e225] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:51:18.506612 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-c33b106d-e1a5-4c46-a5f5-3d1be77e20d3 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc5a4676f6a416cbdc8c67ebd80cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e810a9bc3b44c4aa8ca2ddd0fa68f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:51:18.513215 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-c33b106d-e1a5-4c46-a5f5-3d1be77e20d3 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] 10.222.0.13 "GET /compute/v2.1/servers/4da97884-614a-462c-acfd-09b46602e225" status: 200 len: 1093 microversion: 2.1 time: 0.069230 Jun 23 11:51:18.513777 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 374/779] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:51:18 2022] GET /compute/v2.1/servers/4da97884-614a-462c-acfd-09b46602e225 => generated 1093 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:51:19.255583 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-178028c4-cd4b-4a3d-ac3a-089ae2103943 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:51:19.256204 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-178028c4-cd4b-4a3d-ac3a-089ae2103943 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 284456f6-2347-46c7-bec1-2acb170b7421] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:51:19.262931 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-178028c4-cd4b-4a3d-ac3a-089ae2103943 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:19.263382 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-178028c4-cd4b-4a3d-ac3a-089ae2103943 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:19.264664 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-178028c4-cd4b-4a3d-ac3a-089ae2103943 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:19.265105 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-178028c4-cd4b-4a3d-ac3a-089ae2103943 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:19.394990 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-178028c4-cd4b-4a3d-ac3a-089ae2103943 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:51:19.402372 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-178028c4-cd4b-4a3d-ac3a-089ae2103943 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/284456f6-2347-46c7-bec1-2acb170b7421" status: 200 len: 1556 microversion: 2.1 time: 0.150767 Jun 23 11:51:19.402979 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 406/780] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:51:19 2022] GET /compute/v2.1/servers/284456f6-2347-46c7-bec1-2acb170b7421 => generated 1556 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:51:19.419936 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-5ce9fb7d-8377-400e-acec-6ae6923c866b tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:51:19.420480 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-5ce9fb7d-8377-400e-acec-6ae6923c866b tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 284456f6-2347-46c7-bec1-2acb170b7421] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:51:19.429049 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-5ce9fb7d-8377-400e-acec-6ae6923c866b tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:19.429049 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-5ce9fb7d-8377-400e-acec-6ae6923c866b tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:19.429049 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-5ce9fb7d-8377-400e-acec-6ae6923c866b tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:19.429049 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-5ce9fb7d-8377-400e-acec-6ae6923c866b tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:19.508299 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-5ce9fb7d-8377-400e-acec-6ae6923c866b tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/284456f6-2347-46c7-bec1-2acb170b7421/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092166 Jun 23 11:51:19.508979 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 375/781] 10.222.0.13 () {58 vars in 1274 bytes} [Thu Jun 23 11:51:19 2022] GET /compute/v2.1/servers/284456f6-2347-46c7-bec1-2acb170b7421/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:51:19.530440 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-70bdf5f6-6144-4b11-a3de-e46b8b4c93c8 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:51:19.531193 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-70bdf5f6-6144-4b11-a3de-e46b8b4c93c8 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] [instance: 4da97884-614a-462c-acfd-09b46602e225] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:51:19.537398 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-70bdf5f6-6144-4b11-a3de-e46b8b4c93c8 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:19.537973 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-70bdf5f6-6144-4b11-a3de-e46b8b4c93c8 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:19.538766 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-70bdf5f6-6144-4b11-a3de-e46b8b4c93c8 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:19.539209 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-70bdf5f6-6144-4b11-a3de-e46b8b4c93c8 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:19.844697 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-70bdf5f6-6144-4b11-a3de-e46b8b4c93c8 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc5a4676f6a416cbdc8c67ebd80cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e810a9bc3b44c4aa8ca2ddd0fa68f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:51:19.852569 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-70bdf5f6-6144-4b11-a3de-e46b8b4c93c8 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] 10.222.0.13 "GET /compute/v2.1/servers/4da97884-614a-462c-acfd-09b46602e225" status: 200 len: 1143 microversion: 2.1 time: 0.326523 Jun 23 11:51:19.858676 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 407/782] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:51:19 2022] GET /compute/v2.1/servers/4da97884-614a-462c-acfd-09b46602e225 => generated 1143 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:51:20.865771 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [req-567684ee-ba2e-4412-9fc4-716f1a925f8b req-29c66885-47e5-43bf-8aa8-4eb6bb10bfb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "284456f6-2347-46c7-bec1-2acb170b7421", "tag": "22516136-8ac5-4a18-ba8f-bc1b5f85a4dd"}]} {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:51:20.870616 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-f0419d9c-1bc5-4059-b836-17fb4b0e0222 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:51:20.871987 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-f0419d9c-1bc5-4059-b836-17fb4b0e0222 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] [instance: 4da97884-614a-462c-acfd-09b46602e225] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:51:20.877501 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [req-567684ee-ba2e-4412-9fc4-716f1a925f8b req-29c66885-47e5-43bf-8aa8-4eb6bb10bfb7 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:20.878195 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [req-567684ee-ba2e-4412-9fc4-716f1a925f8b req-29c66885-47e5-43bf-8aa8-4eb6bb10bfb7 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:20.879583 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-f0419d9c-1bc5-4059-b836-17fb4b0e0222 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:20.880255 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-f0419d9c-1bc5-4059-b836-17fb4b0e0222 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:20.882059 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-f0419d9c-1bc5-4059-b836-17fb4b0e0222 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:20.882683 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-f0419d9c-1bc5-4059-b836-17fb4b0e0222 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:20.892793 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.compute.server_external_events [req-567684ee-ba2e-4412-9fc4-716f1a925f8b req-29c66885-47e5-43bf-8aa8-4eb6bb10bfb7 service nova] Creating event network-changed:22516136-8ac5-4a18-ba8f-bc1b5f85a4dd for instance 284456f6-2347-46c7-bec1-2acb170b7421 on hv-cinder-82099 Jun 23 11:51:20.898280 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [req-567684ee-ba2e-4412-9fc4-716f1a925f8b req-29c66885-47e5-43bf-8aa8-4eb6bb10bfb7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121069 Jun 23 11:51:20.899490 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 376/783] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:51:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:51:20.964616 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-f0419d9c-1bc5-4059-b836-17fb4b0e0222 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc5a4676f6a416cbdc8c67ebd80cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e810a9bc3b44c4aa8ca2ddd0fa68f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:51:20.977154 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-f0419d9c-1bc5-4059-b836-17fb4b0e0222 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] 10.222.0.13 "GET /compute/v2.1/servers/4da97884-614a-462c-acfd-09b46602e225" status: 200 len: 1209 microversion: 2.1 time: 0.110967 Jun 23 11:51:20.978401 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 408/784] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:51:20 2022] GET /compute/v2.1/servers/4da97884-614a-462c-acfd-09b46602e225 => generated 1209 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:51:21.996400 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-87b9c507-66a5-4245-a25f-c6f3fa7ab6ea tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:51:22.006789 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-87b9c507-66a5-4245-a25f-c6f3fa7ab6ea tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] [instance: 4da97884-614a-462c-acfd-09b46602e225] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:51:22.006789 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-87b9c507-66a5-4245-a25f-c6f3fa7ab6ea tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:22.006789 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-87b9c507-66a5-4245-a25f-c6f3fa7ab6ea tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:22.006789 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-87b9c507-66a5-4245-a25f-c6f3fa7ab6ea tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:22.008459 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-87b9c507-66a5-4245-a25f-c6f3fa7ab6ea tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:22.168703 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-87b9c507-66a5-4245-a25f-c6f3fa7ab6ea tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc5a4676f6a416cbdc8c67ebd80cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e810a9bc3b44c4aa8ca2ddd0fa68f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:51:22.177553 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-87b9c507-66a5-4245-a25f-c6f3fa7ab6ea tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] 10.222.0.13 "GET /compute/v2.1/servers/4da97884-614a-462c-acfd-09b46602e225" status: 200 len: 1277 microversion: 2.1 time: 0.185858 Jun 23 11:51:22.185159 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 377/785] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:51:21 2022] GET /compute/v2.1/servers/4da97884-614a-462c-acfd-09b46602e225 => generated 1277 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:51:22.510640 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [req-f7b8128a-b47a-4bd0-abc0-45dcdf9aae53 req-10943b42-c6ca-4d16-8886-e5cb0fb9f622 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4da97884-614a-462c-acfd-09b46602e225", "tag": "1e8cd20b-7797-4fd2-930f-31e718325656"}]} {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:51:22.519992 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-f7b8128a-b47a-4bd0-abc0-45dcdf9aae53 req-10943b42-c6ca-4d16-8886-e5cb0fb9f622 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:22.520437 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-f7b8128a-b47a-4bd0-abc0-45dcdf9aae53 req-10943b42-c6ca-4d16-8886-e5cb0fb9f622 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:22.532558 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.compute.server_external_events [req-f7b8128a-b47a-4bd0-abc0-45dcdf9aae53 req-10943b42-c6ca-4d16-8886-e5cb0fb9f622 service nova] Creating event network-changed:1e8cd20b-7797-4fd2-930f-31e718325656 for instance 4da97884-614a-462c-acfd-09b46602e225 on hv-cinder-82099 Jun 23 11:51:22.537940 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [req-f7b8128a-b47a-4bd0-abc0-45dcdf9aae53 req-10943b42-c6ca-4d16-8886-e5cb0fb9f622 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031193 Jun 23 11:51:22.538869 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 409/786] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:51:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:51:23.194909 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-272ca4f5-1d35-4320-ae4a-a367d24cce63 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:51:23.195526 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-272ca4f5-1d35-4320-ae4a-a367d24cce63 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] [instance: 4da97884-614a-462c-acfd-09b46602e225] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:51:23.202914 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-272ca4f5-1d35-4320-ae4a-a367d24cce63 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:23.211214 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-272ca4f5-1d35-4320-ae4a-a367d24cce63 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:23.211214 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-272ca4f5-1d35-4320-ae4a-a367d24cce63 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:23.211214 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-272ca4f5-1d35-4320-ae4a-a367d24cce63 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:23.337572 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-272ca4f5-1d35-4320-ae4a-a367d24cce63 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc5a4676f6a416cbdc8c67ebd80cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e810a9bc3b44c4aa8ca2ddd0fa68f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:51:23.345557 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-272ca4f5-1d35-4320-ae4a-a367d24cce63 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] 10.222.0.13 "GET /compute/v2.1/servers/4da97884-614a-462c-acfd-09b46602e225" status: 200 len: 1265 microversion: 2.1 time: 0.154468 Jun 23 11:51:23.346380 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 378/787] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:51:23 2022] GET /compute/v2.1/servers/4da97884-614a-462c-acfd-09b46602e225 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:51:24.363405 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-2bec3618-a81a-44e7-8035-c02d6f6bd3d7 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:51:24.364104 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-2bec3618-a81a-44e7-8035-c02d6f6bd3d7 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] [instance: 4da97884-614a-462c-acfd-09b46602e225] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:51:24.370681 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-2bec3618-a81a-44e7-8035-c02d6f6bd3d7 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:24.371213 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-2bec3618-a81a-44e7-8035-c02d6f6bd3d7 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:24.371987 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-2bec3618-a81a-44e7-8035-c02d6f6bd3d7 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:24.372424 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-2bec3618-a81a-44e7-8035-c02d6f6bd3d7 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:24.508940 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-2bec3618-a81a-44e7-8035-c02d6f6bd3d7 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc5a4676f6a416cbdc8c67ebd80cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e810a9bc3b44c4aa8ca2ddd0fa68f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:51:24.517419 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-2bec3618-a81a-44e7-8035-c02d6f6bd3d7 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] 10.222.0.13 "GET /compute/v2.1/servers/4da97884-614a-462c-acfd-09b46602e225" status: 200 len: 1265 microversion: 2.1 time: 0.158254 Jun 23 11:51:24.517974 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 410/788] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:51:24 2022] GET /compute/v2.1/servers/4da97884-614a-462c-acfd-09b46602e225 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:51:25.542175 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-178181d3-2c50-412a-9648-5253fd8c2c25 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:51:25.542820 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-178181d3-2c50-412a-9648-5253fd8c2c25 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] [instance: 4da97884-614a-462c-acfd-09b46602e225] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:51:25.550043 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-178181d3-2c50-412a-9648-5253fd8c2c25 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:25.550490 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-178181d3-2c50-412a-9648-5253fd8c2c25 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:25.551266 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-178181d3-2c50-412a-9648-5253fd8c2c25 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:25.551698 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-178181d3-2c50-412a-9648-5253fd8c2c25 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:25.678477 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-178181d3-2c50-412a-9648-5253fd8c2c25 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc5a4676f6a416cbdc8c67ebd80cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e810a9bc3b44c4aa8ca2ddd0fa68f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:51:25.685870 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-178181d3-2c50-412a-9648-5253fd8c2c25 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] 10.222.0.13 "GET /compute/v2.1/servers/4da97884-614a-462c-acfd-09b46602e225" status: 200 len: 1265 microversion: 2.1 time: 0.147514 Jun 23 11:51:25.687012 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 379/789] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:51:25 2022] GET /compute/v2.1/servers/4da97884-614a-462c-acfd-09b46602e225 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:51:26.703534 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-524c0f7c-8bdd-46b7-9994-c133a7c4bb17 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:51:26.704140 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-524c0f7c-8bdd-46b7-9994-c133a7c4bb17 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] [instance: 4da97884-614a-462c-acfd-09b46602e225] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:51:26.710219 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-524c0f7c-8bdd-46b7-9994-c133a7c4bb17 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:26.710710 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-524c0f7c-8bdd-46b7-9994-c133a7c4bb17 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:26.711471 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-524c0f7c-8bdd-46b7-9994-c133a7c4bb17 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:26.711906 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-524c0f7c-8bdd-46b7-9994-c133a7c4bb17 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:26.841774 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-524c0f7c-8bdd-46b7-9994-c133a7c4bb17 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc5a4676f6a416cbdc8c67ebd80cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e810a9bc3b44c4aa8ca2ddd0fa68f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:51:26.850049 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-524c0f7c-8bdd-46b7-9994-c133a7c4bb17 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] 10.222.0.13 "GET /compute/v2.1/servers/4da97884-614a-462c-acfd-09b46602e225" status: 200 len: 1265 microversion: 2.1 time: 0.150839 Jun 23 11:51:26.850626 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 411/790] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:51:26 2022] GET /compute/v2.1/servers/4da97884-614a-462c-acfd-09b46602e225 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:51:27.866699 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-e43c1721-1afd-4ce7-823b-04e10929de01 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:51:27.867316 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-e43c1721-1afd-4ce7-823b-04e10929de01 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] [instance: 4da97884-614a-462c-acfd-09b46602e225] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:51:27.874646 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-e43c1721-1afd-4ce7-823b-04e10929de01 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:27.875135 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-e43c1721-1afd-4ce7-823b-04e10929de01 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:27.875906 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-e43c1721-1afd-4ce7-823b-04e10929de01 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:27.876346 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-e43c1721-1afd-4ce7-823b-04e10929de01 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:28.006048 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-e43c1721-1afd-4ce7-823b-04e10929de01 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc5a4676f6a416cbdc8c67ebd80cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e810a9bc3b44c4aa8ca2ddd0fa68f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:51:28.013556 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-e43c1721-1afd-4ce7-823b-04e10929de01 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] 10.222.0.13 "GET /compute/v2.1/servers/4da97884-614a-462c-acfd-09b46602e225" status: 200 len: 1265 microversion: 2.1 time: 0.150678 Jun 23 11:51:28.014119 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 380/791] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:51:27 2022] GET /compute/v2.1/servers/4da97884-614a-462c-acfd-09b46602e225 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:51:29.031563 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-788f0d3b-1045-435c-b716-5a3e701fdbfe tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:51:29.032117 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-788f0d3b-1045-435c-b716-5a3e701fdbfe tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] [instance: 4da97884-614a-462c-acfd-09b46602e225] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:51:29.034131 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_cell0:SELECT=2 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:51:29.034802 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_cell0:SELECT=6 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:51:29.039692 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-788f0d3b-1045-435c-b716-5a3e701fdbfe tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:29.040917 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-788f0d3b-1045-435c-b716-5a3e701fdbfe tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:29.040917 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-788f0d3b-1045-435c-b716-5a3e701fdbfe tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:29.041303 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-788f0d3b-1045-435c-b716-5a3e701fdbfe tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:29.174284 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-788f0d3b-1045-435c-b716-5a3e701fdbfe tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc5a4676f6a416cbdc8c67ebd80cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e810a9bc3b44c4aa8ca2ddd0fa68f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:51:29.181744 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-788f0d3b-1045-435c-b716-5a3e701fdbfe tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] 10.222.0.13 "GET /compute/v2.1/servers/4da97884-614a-462c-acfd-09b46602e225" status: 200 len: 1265 microversion: 2.1 time: 0.154843 Jun 23 11:51:29.182305 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 412/792] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:51:29 2022] GET /compute/v2.1/servers/4da97884-614a-462c-acfd-09b46602e225 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:51:30.198759 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-4e6f85f2-5d8c-4efd-bcc6-8b89d78227f4 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:51:30.199361 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-4e6f85f2-5d8c-4efd-bcc6-8b89d78227f4 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] [instance: 4da97884-614a-462c-acfd-09b46602e225] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:51:30.201344 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_cell0:SELECT=2 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:51:30.206952 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-4e6f85f2-5d8c-4efd-bcc6-8b89d78227f4 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:30.207397 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-4e6f85f2-5d8c-4efd-bcc6-8b89d78227f4 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:30.208142 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-4e6f85f2-5d8c-4efd-bcc6-8b89d78227f4 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:30.208571 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-4e6f85f2-5d8c-4efd-bcc6-8b89d78227f4 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:30.337073 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-4e6f85f2-5d8c-4efd-bcc6-8b89d78227f4 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc5a4676f6a416cbdc8c67ebd80cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e810a9bc3b44c4aa8ca2ddd0fa68f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:51:30.344638 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-4e6f85f2-5d8c-4efd-bcc6-8b89d78227f4 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] 10.222.0.13 "GET /compute/v2.1/servers/4da97884-614a-462c-acfd-09b46602e225" status: 200 len: 1265 microversion: 2.1 time: 0.149831 Jun 23 11:51:30.345190 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 381/793] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:51:30 2022] GET /compute/v2.1/servers/4da97884-614a-462c-acfd-09b46602e225 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:51:31.361594 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-5e7cb1e3-5915-4770-b604-be4cf088926a tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:51:31.362209 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-5e7cb1e3-5915-4770-b604-be4cf088926a tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] [instance: 4da97884-614a-462c-acfd-09b46602e225] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:51:31.369411 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-5e7cb1e3-5915-4770-b604-be4cf088926a tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:31.369860 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-5e7cb1e3-5915-4770-b604-be4cf088926a tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:31.370643 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-5e7cb1e3-5915-4770-b604-be4cf088926a tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:31.371079 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-5e7cb1e3-5915-4770-b604-be4cf088926a tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:31.511413 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-5e7cb1e3-5915-4770-b604-be4cf088926a tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc5a4676f6a416cbdc8c67ebd80cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e810a9bc3b44c4aa8ca2ddd0fa68f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:51:31.520047 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-5e7cb1e3-5915-4770-b604-be4cf088926a tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] 10.222.0.13 "GET /compute/v2.1/servers/4da97884-614a-462c-acfd-09b46602e225" status: 200 len: 1265 microversion: 2.1 time: 0.162662 Jun 23 11:51:31.529671 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 413/794] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:51:31 2022] GET /compute/v2.1/servers/4da97884-614a-462c-acfd-09b46602e225 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:51:32.537517 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-e52ef192-968c-4277-8934-e227dbea87dc tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:51:32.538133 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-e52ef192-968c-4277-8934-e227dbea87dc tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] [instance: 4da97884-614a-462c-acfd-09b46602e225] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:51:32.544694 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-e52ef192-968c-4277-8934-e227dbea87dc tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:32.545152 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-e52ef192-968c-4277-8934-e227dbea87dc tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:32.546580 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-e52ef192-968c-4277-8934-e227dbea87dc tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:32.547173 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-e52ef192-968c-4277-8934-e227dbea87dc tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:32.679020 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-e52ef192-968c-4277-8934-e227dbea87dc tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc5a4676f6a416cbdc8c67ebd80cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e810a9bc3b44c4aa8ca2ddd0fa68f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:51:32.687162 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-e52ef192-968c-4277-8934-e227dbea87dc tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] 10.222.0.13 "GET /compute/v2.1/servers/4da97884-614a-462c-acfd-09b46602e225" status: 200 len: 1265 microversion: 2.1 time: 0.153257 Jun 23 11:51:32.688976 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 382/795] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:51:32 2022] GET /compute/v2.1/servers/4da97884-614a-462c-acfd-09b46602e225 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:51:33.704620 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-bd2cdc75-1cc9-4d24-894c-729399c3908c tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:51:33.705224 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-bd2cdc75-1cc9-4d24-894c-729399c3908c tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] [instance: 4da97884-614a-462c-acfd-09b46602e225] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:51:33.711256 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-bd2cdc75-1cc9-4d24-894c-729399c3908c tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:33.711705 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-bd2cdc75-1cc9-4d24-894c-729399c3908c tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:33.712457 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-bd2cdc75-1cc9-4d24-894c-729399c3908c tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:33.712890 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-bd2cdc75-1cc9-4d24-894c-729399c3908c tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:33.840311 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-bd2cdc75-1cc9-4d24-894c-729399c3908c tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc5a4676f6a416cbdc8c67ebd80cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e810a9bc3b44c4aa8ca2ddd0fa68f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:51:33.848131 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-bd2cdc75-1cc9-4d24-894c-729399c3908c tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] 10.222.0.13 "GET /compute/v2.1/servers/4da97884-614a-462c-acfd-09b46602e225" status: 200 len: 1265 microversion: 2.1 time: 0.148002 Jun 23 11:51:33.848772 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 414/796] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:51:33 2022] GET /compute/v2.1/servers/4da97884-614a-462c-acfd-09b46602e225 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:51:34.447236 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [req-8dd781bc-87c2-46db-87f9-01828fa34c05 req-48fd5c3f-7324-440e-a489-966246b661d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4da97884-614a-462c-acfd-09b46602e225", "name": "network-vif-plugged", "status": "completed", "tag": "1e8cd20b-7797-4fd2-930f-31e718325656"}]} {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:51:34.456049 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [req-8dd781bc-87c2-46db-87f9-01828fa34c05 req-48fd5c3f-7324-440e-a489-966246b661d8 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:34.456501 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [req-8dd781bc-87c2-46db-87f9-01828fa34c05 req-48fd5c3f-7324-440e-a489-966246b661d8 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:34.467151 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.compute.server_external_events [req-8dd781bc-87c2-46db-87f9-01828fa34c05 req-48fd5c3f-7324-440e-a489-966246b661d8 service nova] Creating event network-vif-plugged:1e8cd20b-7797-4fd2-930f-31e718325656 for instance 4da97884-614a-462c-acfd-09b46602e225 on hv-cinder-82099 Jun 23 11:51:34.473074 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [req-8dd781bc-87c2-46db-87f9-01828fa34c05 req-48fd5c3f-7324-440e-a489-966246b661d8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029609 Jun 23 11:51:34.473647 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 383/797] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:51:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:51:34.865343 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-53dc608e-2d58-4a72-8330-d3b580b8a4f6 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:51:34.866025 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-53dc608e-2d58-4a72-8330-d3b580b8a4f6 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] [instance: 4da97884-614a-462c-acfd-09b46602e225] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:51:34.872223 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-53dc608e-2d58-4a72-8330-d3b580b8a4f6 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:34.872679 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-53dc608e-2d58-4a72-8330-d3b580b8a4f6 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:34.873440 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-53dc608e-2d58-4a72-8330-d3b580b8a4f6 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:34.874090 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-53dc608e-2d58-4a72-8330-d3b580b8a4f6 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:35.006924 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-53dc608e-2d58-4a72-8330-d3b580b8a4f6 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc5a4676f6a416cbdc8c67ebd80cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e810a9bc3b44c4aa8ca2ddd0fa68f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:51:35.014213 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-53dc608e-2d58-4a72-8330-d3b580b8a4f6 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] 10.222.0.13 "GET /compute/v2.1/servers/4da97884-614a-462c-acfd-09b46602e225" status: 200 len: 1265 microversion: 2.1 time: 0.152795 Jun 23 11:51:35.015287 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 415/798] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:51:34 2022] GET /compute/v2.1/servers/4da97884-614a-462c-acfd-09b46602e225 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:51:36.032959 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-9c9261af-3156-4c29-a04a-cb1fa1b4a20f tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:51:36.033667 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-9c9261af-3156-4c29-a04a-cb1fa1b4a20f tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] [instance: 4da97884-614a-462c-acfd-09b46602e225] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:51:36.039886 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-9c9261af-3156-4c29-a04a-cb1fa1b4a20f tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:36.040340 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-9c9261af-3156-4c29-a04a-cb1fa1b4a20f tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:36.041103 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-9c9261af-3156-4c29-a04a-cb1fa1b4a20f tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:36.041544 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-9c9261af-3156-4c29-a04a-cb1fa1b4a20f tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:36.170652 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-9c9261af-3156-4c29-a04a-cb1fa1b4a20f tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc5a4676f6a416cbdc8c67ebd80cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e810a9bc3b44c4aa8ca2ddd0fa68f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:51:36.179011 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-9c9261af-3156-4c29-a04a-cb1fa1b4a20f tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] 10.222.0.13 "GET /compute/v2.1/servers/4da97884-614a-462c-acfd-09b46602e225" status: 200 len: 1265 microversion: 2.1 time: 0.151363 Jun 23 11:51:36.179589 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 384/799] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:51:36 2022] GET /compute/v2.1/servers/4da97884-614a-462c-acfd-09b46602e225 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:51:36.564926 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-f76b0438-95fe-4a07-aed3-f6e74219aa9d tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:51:36.565487 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-f76b0438-95fe-4a07-aed3-f6e74219aa9d tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 6b648e87-b71a-4ef3-aada-f884b8efb154] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:51:36.571344 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-f76b0438-95fe-4a07-aed3-f6e74219aa9d tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:36.571785 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-f76b0438-95fe-4a07-aed3-f6e74219aa9d tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:36.572532 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-f76b0438-95fe-4a07-aed3-f6e74219aa9d tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:36.572958 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-f76b0438-95fe-4a07-aed3-f6e74219aa9d tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:36.650385 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:51:36.656429 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.objects.instance [None req-f76b0438-95fe-4a07-aed3-f6e74219aa9d tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lazy-loading 'services' on Instance uuid 6b648e87-b71a-4ef3-aada-f884b8efb154 {{(pid=124670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:51:36.846955 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-f76b0438-95fe-4a07-aed3-f6e74219aa9d tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "DELETE /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154/os-volume_attachments/ff87e09b-2262-45d8-aade-6673642c4a09" status: 202 len: 0 microversion: 2.1 time: 0.285816 Jun 23 11:51:36.847549 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 416/800] 10.222.0.13 () {58 vars in 1415 bytes} [Thu Jun 23 11:51:36 2022] DELETE /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154/os-volume_attachments/ff87e09b-2262-45d8-aade-6673642c4a09 => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 11:51:36.856093 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-bc840281-ed4e-4d53-a931-ad743b3bd9e7 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:51:36.857016 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-bc840281-ed4e-4d53-a931-ad743b3bd9e7 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 6b648e87-b71a-4ef3-aada-f884b8efb154] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:51:36.864569 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-bc840281-ed4e-4d53-a931-ad743b3bd9e7 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:36.867807 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-bc840281-ed4e-4d53-a931-ad743b3bd9e7 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:36.867807 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-bc840281-ed4e-4d53-a931-ad743b3bd9e7 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:36.867807 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-bc840281-ed4e-4d53-a931-ad743b3bd9e7 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:36.895520 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-bc840281-ed4e-4d53-a931-ad743b3bd9e7 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043324 Jun 23 11:51:36.896067 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 385/801] 10.222.0.13 () {58 vars in 1301 bytes} [Thu Jun 23 11:51:36 2022] GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:51:37.196933 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-58125369-5dc4-4489-a054-f19ac8bccc98 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:51:37.197641 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-58125369-5dc4-4489-a054-f19ac8bccc98 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] [instance: 4da97884-614a-462c-acfd-09b46602e225] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:51:37.205003 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-58125369-5dc4-4489-a054-f19ac8bccc98 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:37.205530 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-58125369-5dc4-4489-a054-f19ac8bccc98 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:37.206304 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-58125369-5dc4-4489-a054-f19ac8bccc98 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:37.206767 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-58125369-5dc4-4489-a054-f19ac8bccc98 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:37.338677 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-58125369-5dc4-4489-a054-f19ac8bccc98 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc5a4676f6a416cbdc8c67ebd80cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e810a9bc3b44c4aa8ca2ddd0fa68f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:51:37.347290 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-58125369-5dc4-4489-a054-f19ac8bccc98 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] 10.222.0.13 "GET /compute/v2.1/servers/4da97884-614a-462c-acfd-09b46602e225" status: 200 len: 1451 microversion: 2.1 time: 0.154815 Jun 23 11:51:37.347841 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 417/802] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:51:37 2022] GET /compute/v2.1/servers/4da97884-614a-462c-acfd-09b46602e225 => generated 1451 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:51:37.363508 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-ef1a385c-c87a-42a5-8191-454ccdb95166 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:51:37.364113 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-ef1a385c-c87a-42a5-8191-454ccdb95166 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] [instance: 4da97884-614a-462c-acfd-09b46602e225] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:51:37.370422 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ef1a385c-c87a-42a5-8191-454ccdb95166 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:37.370896 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ef1a385c-c87a-42a5-8191-454ccdb95166 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:37.371640 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ef1a385c-c87a-42a5-8191-454ccdb95166 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:37.372072 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ef1a385c-c87a-42a5-8191-454ccdb95166 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:37.506520 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-ef1a385c-c87a-42a5-8191-454ccdb95166 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc5a4676f6a416cbdc8c67ebd80cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e810a9bc3b44c4aa8ca2ddd0fa68f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:51:37.514069 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-ef1a385c-c87a-42a5-8191-454ccdb95166 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] 10.222.0.13 "GET /compute/v2.1/servers/4da97884-614a-462c-acfd-09b46602e225" status: 200 len: 1451 microversion: 2.1 time: 0.154293 Jun 23 11:51:37.515511 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 386/803] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:51:37 2022] GET /compute/v2.1/servers/4da97884-614a-462c-acfd-09b46602e225 => generated 1451 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:51:37.906988 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-1c4e26a1-84ed-4a78-beb1-59e4de034bbd tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:51:37.908107 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-1c4e26a1-84ed-4a78-beb1-59e4de034bbd tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 6b648e87-b71a-4ef3-aada-f884b8efb154] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:51:37.915203 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1c4e26a1-84ed-4a78-beb1-59e4de034bbd tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:37.915730 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1c4e26a1-84ed-4a78-beb1-59e4de034bbd tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:37.916701 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1c4e26a1-84ed-4a78-beb1-59e4de034bbd tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:37.917360 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1c4e26a1-84ed-4a78-beb1-59e4de034bbd tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:37.950298 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-1c4e26a1-84ed-4a78-beb1-59e4de034bbd tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047739 Jun 23 11:51:37.950884 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 418/804] 10.222.0.13 () {58 vars in 1301 bytes} [Thu Jun 23 11:51:37 2022] GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:51:38.962901 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-0cb4939f-55cf-44a7-add9-fbd6d41a7e89 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:51:38.963896 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-0cb4939f-55cf-44a7-add9-fbd6d41a7e89 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 6b648e87-b71a-4ef3-aada-f884b8efb154] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:51:38.971009 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-0cb4939f-55cf-44a7-add9-fbd6d41a7e89 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:38.971731 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-0cb4939f-55cf-44a7-add9-fbd6d41a7e89 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:38.972518 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-0cb4939f-55cf-44a7-add9-fbd6d41a7e89 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:38.972959 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-0cb4939f-55cf-44a7-add9-fbd6d41a7e89 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:38.991044 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_cell1:SELECT=100 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:51:39.005094 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-0cb4939f-55cf-44a7-add9-fbd6d41a7e89 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046315 Jun 23 11:51:39.008452 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 387/805] 10.222.0.13 () {58 vars in 1301 bytes} [Thu Jun 23 11:51:38 2022] GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 11:51:39.082028 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-37af113f-61e0-4461-9d35-4b0f21c05267 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:51:39.082624 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-37af113f-61e0-4461-9d35-4b0f21c05267 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 6b648e87-b71a-4ef3-aada-f884b8efb154] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:51:39.088889 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-37af113f-61e0-4461-9d35-4b0f21c05267 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:39.089338 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-37af113f-61e0-4461-9d35-4b0f21c05267 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:39.090109 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-37af113f-61e0-4461-9d35-4b0f21c05267 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:39.090626 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-37af113f-61e0-4461-9d35-4b0f21c05267 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:39.116417 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-37af113f-61e0-4461-9d35-4b0f21c05267 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 6b648e87-b71a-4ef3-aada-f884b8efb154] Going to try to terminate instance {{(pid=124670) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 11:51:39.349663 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-37af113f-61e0-4461-9d35-4b0f21c05267 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "DELETE /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154" status: 204 len: 0 microversion: 2.1 time: 0.272074 Jun 23 11:51:39.350482 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 419/806] 10.222.0.13 () {58 vars in 1238 bytes} [Thu Jun 23 11:51:39 2022] DELETE /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 11:51:39.359025 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-6e7c00bf-6e68-4d82-88d1-9170260fad93 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:51:39.363778 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-6e7c00bf-6e68-4d82-88d1-9170260fad93 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 6b648e87-b71a-4ef3-aada-f884b8efb154] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:51:39.366307 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-6e7c00bf-6e68-4d82-88d1-9170260fad93 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:39.366796 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-6e7c00bf-6e68-4d82-88d1-9170260fad93 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:39.367563 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-6e7c00bf-6e68-4d82-88d1-9170260fad93 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:39.368000 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-6e7c00bf-6e68-4d82-88d1-9170260fad93 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:39.575614 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-6e7c00bf-6e68-4d82-88d1-9170260fad93 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:51:39.583417 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-6e7c00bf-6e68-4d82-88d1-9170260fad93 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154" status: 200 len: 1688 microversion: 2.1 time: 0.228904 Jun 23 11:51:39.586905 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 388/807] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:51:39 2022] GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154 => generated 1688 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:51:39.693898 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [req-d693a262-661b-4c33-9148-1ee765b5aa94 req-edab22fb-fd42-43ee-b213-413e892f7a77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4da97884-614a-462c-acfd-09b46602e225", "tag": "1e8cd20b-7797-4fd2-930f-31e718325656"}]} {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:51:39.702057 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-d693a262-661b-4c33-9148-1ee765b5aa94 req-edab22fb-fd42-43ee-b213-413e892f7a77 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:39.702759 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-d693a262-661b-4c33-9148-1ee765b5aa94 req-edab22fb-fd42-43ee-b213-413e892f7a77 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:39.714562 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.compute.server_external_events [req-d693a262-661b-4c33-9148-1ee765b5aa94 req-edab22fb-fd42-43ee-b213-413e892f7a77 service nova] Creating event network-changed:1e8cd20b-7797-4fd2-930f-31e718325656 for instance 4da97884-614a-462c-acfd-09b46602e225 on hv-cinder-82099 Jun 23 11:51:39.720088 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [req-d693a262-661b-4c33-9148-1ee765b5aa94 req-edab22fb-fd42-43ee-b213-413e892f7a77 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030322 Jun 23 11:51:39.720672 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 420/808] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:51:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:51:40.600938 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-2fdead05-e8e1-4e5e-9727-f785c82eaa61 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:51:40.601578 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-2fdead05-e8e1-4e5e-9727-f785c82eaa61 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 6b648e87-b71a-4ef3-aada-f884b8efb154] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:51:40.608186 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-2fdead05-e8e1-4e5e-9727-f785c82eaa61 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:40.609271 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-2fdead05-e8e1-4e5e-9727-f785c82eaa61 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:40.610046 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-2fdead05-e8e1-4e5e-9727-f785c82eaa61 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:40.610483 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-2fdead05-e8e1-4e5e-9727-f785c82eaa61 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:40.744150 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-2fdead05-e8e1-4e5e-9727-f785c82eaa61 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:51:40.752328 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-2fdead05-e8e1-4e5e-9727-f785c82eaa61 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154" status: 200 len: 1688 microversion: 2.1 time: 0.155487 Jun 23 11:51:40.752888 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 389/809] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:51:40 2022] GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154 => generated 1688 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:51:41.314382 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-ef4e3fea-5f92-4dc6-a40a-dec0eab42c16 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:51:41.315006 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-ef4e3fea-5f92-4dc6-a40a-dec0eab42c16 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:51:41.321209 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-ef4e3fea-5f92-4dc6-a40a-dec0eab42c16 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:41.321651 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-ef4e3fea-5f92-4dc6-a40a-dec0eab42c16 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:41.322399 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-ef4e3fea-5f92-4dc6-a40a-dec0eab42c16 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:41.322872 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-ef4e3fea-5f92-4dc6-a40a-dec0eab42c16 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:41.351701 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-ef4e3fea-5f92-4dc6-a40a-dec0eab42c16 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961/os-volume_attachments/221b37a4-e7a5-4dc4-903a-9832df2eaade" status: 200 len: 194 microversion: 2.20 time: 0.138678 Jun 23 11:51:41.352260 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 421/810] 10.222.0.13 () {60 vars in 1453 bytes} [Thu Jun 23 11:51:41 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961/os-volume_attachments/221b37a4-e7a5-4dc4-903a-9832df2eaade => generated 194 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 11:51:41.413461 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-fa28a8e5-cb61-4d53-8efb-b808bbf623cc tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:51:41.413962 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-fa28a8e5-cb61-4d53-8efb-b808bbf623cc tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:51:41.420029 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-fa28a8e5-cb61-4d53-8efb-b808bbf623cc tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:41.420486 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-fa28a8e5-cb61-4d53-8efb-b808bbf623cc tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:41.421963 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-fa28a8e5-cb61-4d53-8efb-b808bbf623cc tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:41.422407 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-fa28a8e5-cb61-4d53-8efb-b808bbf623cc tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:41.505576 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.objects.instance [None req-fa28a8e5-cb61-4d53-8efb-b808bbf623cc tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lazy-loading 'services' on Instance uuid d9e98590-5036-4ade-bbba-f743256ac961 {{(pid=124669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:51:41.696345 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-fa28a8e5-cb61-4d53-8efb-b808bbf623cc tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961/os-volume_attachments/221b37a4-e7a5-4dc4-903a-9832df2eaade" status: 202 len: 0 microversion: 2.20 time: 0.286543 Jun 23 11:51:41.697075 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 390/811] 10.222.0.13 () {60 vars in 1456 bytes} [Thu Jun 23 11:51:41 2022] DELETE /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961/os-volume_attachments/221b37a4-e7a5-4dc4-903a-9832df2eaade => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 23 11:51:41.707688 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-bb639e7a-249f-4587-bbf9-4b630e112210 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:51:41.708663 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-bb639e7a-249f-4587-bbf9-4b630e112210 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:51:41.715425 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-bb639e7a-249f-4587-bbf9-4b630e112210 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:41.715873 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-bb639e7a-249f-4587-bbf9-4b630e112210 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:41.716637 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-bb639e7a-249f-4587-bbf9-4b630e112210 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:41.717061 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-bb639e7a-249f-4587-bbf9-4b630e112210 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:41.750161 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-bb639e7a-249f-4587-bbf9-4b630e112210 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046849 Jun 23 11:51:41.750651 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 422/812] 10.222.0.13 () {60 vars in 1342 bytes} [Thu Jun 23 11:51:41 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 23 11:51:41.769543 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-fa284b60-3269-4ba9-a53e-1a37d976ec3e tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:51:41.770281 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-fa284b60-3269-4ba9-a53e-1a37d976ec3e tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 6b648e87-b71a-4ef3-aada-f884b8efb154] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:51:41.776664 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-fa284b60-3269-4ba9-a53e-1a37d976ec3e tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:41.777120 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-fa284b60-3269-4ba9-a53e-1a37d976ec3e tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:41.777877 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-fa284b60-3269-4ba9-a53e-1a37d976ec3e tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:41.778315 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-fa284b60-3269-4ba9-a53e-1a37d976ec3e tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:41.907658 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-fa284b60-3269-4ba9-a53e-1a37d976ec3e tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:51:41.915140 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-fa284b60-3269-4ba9-a53e-1a37d976ec3e tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154" status: 200 len: 1688 microversion: 2.1 time: 0.149759 Jun 23 11:51:41.915723 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 391/813] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:51:41 2022] GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154 => generated 1688 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:51:42.761385 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-b92d2776-ac4e-4bbc-8bc5-513950dfb79d tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:51:42.762236 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-b92d2776-ac4e-4bbc-8bc5-513950dfb79d tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:51:42.768295 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-b92d2776-ac4e-4bbc-8bc5-513950dfb79d tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:42.768740 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-b92d2776-ac4e-4bbc-8bc5-513950dfb79d tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:42.769497 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-b92d2776-ac4e-4bbc-8bc5-513950dfb79d tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:42.769927 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-b92d2776-ac4e-4bbc-8bc5-513950dfb79d tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:42.798608 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-b92d2776-ac4e-4bbc-8bc5-513950dfb79d tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041208 Jun 23 11:51:42.799148 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 423/814] 10.222.0.13 () {60 vars in 1342 bytes} [Thu Jun 23 11:51:42 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 11:51:42.933166 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-18e20692-701e-4684-a363-d2eff5ed59c3 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:51:42.933789 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-18e20692-701e-4684-a363-d2eff5ed59c3 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 6b648e87-b71a-4ef3-aada-f884b8efb154] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:51:42.940477 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-18e20692-701e-4684-a363-d2eff5ed59c3 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:42.940931 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-18e20692-701e-4684-a363-d2eff5ed59c3 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:42.942212 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-18e20692-701e-4684-a363-d2eff5ed59c3 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:42.942821 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-18e20692-701e-4684-a363-d2eff5ed59c3 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:43.081309 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-18e20692-701e-4684-a363-d2eff5ed59c3 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:51:43.090469 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-18e20692-701e-4684-a363-d2eff5ed59c3 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154" status: 200 len: 1688 microversion: 2.1 time: 0.162134 Jun 23 11:51:43.091676 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 392/815] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:51:42 2022] GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154 => generated 1688 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:51:43.810175 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-2232277b-4566-41fe-93fb-6d9c83fb5ffa tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:51:43.811028 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-2232277b-4566-41fe-93fb-6d9c83fb5ffa tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:51:43.813377 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:51:43.819025 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-2232277b-4566-41fe-93fb-6d9c83fb5ffa tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:43.819688 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-2232277b-4566-41fe-93fb-6d9c83fb5ffa tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:43.820638 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-2232277b-4566-41fe-93fb-6d9c83fb5ffa tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:43.821219 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-2232277b-4566-41fe-93fb-6d9c83fb5ffa tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:43.855976 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-2232277b-4566-41fe-93fb-6d9c83fb5ffa tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050572 Jun 23 11:51:43.856584 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 424/816] 10.222.0.13 () {60 vars in 1342 bytes} [Thu Jun 23 11:51:43 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 11:51:44.109725 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-0a46cfad-32f6-460d-993e-f830af7c821f tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:51:44.110350 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-0a46cfad-32f6-460d-993e-f830af7c821f tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 6b648e87-b71a-4ef3-aada-f884b8efb154] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:51:44.113816 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_api:SELECT=54 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:51:44.117208 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-0a46cfad-32f6-460d-993e-f830af7c821f tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:44.117656 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-0a46cfad-32f6-460d-993e-f830af7c821f tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:44.118459 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-0a46cfad-32f6-460d-993e-f830af7c821f tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:44.118915 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-0a46cfad-32f6-460d-993e-f830af7c821f tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:44.376352 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-0a46cfad-32f6-460d-993e-f830af7c821f tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:51:44.384192 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-0a46cfad-32f6-460d-993e-f830af7c821f tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154" status: 200 len: 1688 microversion: 2.1 time: 0.279554 Jun 23 11:51:44.384780 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 393/817] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:51:44 2022] GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154 => generated 1688 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:51:44.867844 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-1612200d-c44c-4a1a-b39e-9602bbbac2e6 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:51:44.869103 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-1612200d-c44c-4a1a-b39e-9602bbbac2e6 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:51:44.876415 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1612200d-c44c-4a1a-b39e-9602bbbac2e6 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:44.876999 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1612200d-c44c-4a1a-b39e-9602bbbac2e6 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:44.878016 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1612200d-c44c-4a1a-b39e-9602bbbac2e6 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:44.878785 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1612200d-c44c-4a1a-b39e-9602bbbac2e6 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:44.892887 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [req-d6670b35-5a28-46a3-8e3c-a97d665042ff req-ca7fb912-6238-40ae-83f9-8a2c75ce19fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b648e87-b71a-4ef3-aada-f884b8efb154", "name": "network-vif-deleted", "tag": "cae1bf17-0db1-4c4a-8280-5a78b15781a7"}]} {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:51:44.900435 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [req-d6670b35-5a28-46a3-8e3c-a97d665042ff req-ca7fb912-6238-40ae-83f9-8a2c75ce19fe service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:44.900881 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [req-d6670b35-5a28-46a3-8e3c-a97d665042ff req-ca7fb912-6238-40ae-83f9-8a2c75ce19fe service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:44.913327 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.compute.server_external_events [req-d6670b35-5a28-46a3-8e3c-a97d665042ff req-ca7fb912-6238-40ae-83f9-8a2c75ce19fe service nova] Creating event network-vif-deleted:cae1bf17-0db1-4c4a-8280-5a78b15781a7 for instance 6b648e87-b71a-4ef3-aada-f884b8efb154 on hv-cinder-82099 Jun 23 11:51:44.914055 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-1612200d-c44c-4a1a-b39e-9602bbbac2e6 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050480 Jun 23 11:51:44.914657 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 425/818] 10.222.0.13 () {60 vars in 1342 bytes} [Thu Jun 23 11:51:44 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:51:44.919574 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [req-d6670b35-5a28-46a3-8e3c-a97d665042ff req-ca7fb912-6238-40ae-83f9-8a2c75ce19fe service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031156 Jun 23 11:51:44.919574 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 394/819] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:51:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:51:44.978673 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-2f068698-45b1-42d4-b2b6-19b8d5d1833b tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:51:44.978673 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-2f068698-45b1-42d4-b2b6-19b8d5d1833b tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:51:44.984507 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-2f068698-45b1-42d4-b2b6-19b8d5d1833b tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:44.984961 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-2f068698-45b1-42d4-b2b6-19b8d5d1833b tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:44.985743 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-2f068698-45b1-42d4-b2b6-19b8d5d1833b tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:44.986184 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-2f068698-45b1-42d4-b2b6-19b8d5d1833b tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:45.013087 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-2f068698-45b1-42d4-b2b6-19b8d5d1833b tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Going to try to terminate instance {{(pid=124669) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 11:51:45.309177 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-2f068698-45b1-42d4-b2b6-19b8d5d1833b tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 204 len: 0 microversion: 2.20 time: 0.335628 Jun 23 11:51:45.310638 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 395/820] 10.222.0.13 () {60 vars in 1279 bytes} [Thu Jun 23 11:51:44 2022] DELETE /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 23 11:51:45.319909 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-a5bbe53e-cc02-43d1-ad62-12d65416ca01 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:51:45.325184 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-a5bbe53e-cc02-43d1-ad62-12d65416ca01 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:51:45.326450 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a5bbe53e-cc02-43d1-ad62-12d65416ca01 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:45.326930 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a5bbe53e-cc02-43d1-ad62-12d65416ca01 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:45.327691 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a5bbe53e-cc02-43d1-ad62-12d65416ca01 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:45.328114 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a5bbe53e-cc02-43d1-ad62-12d65416ca01 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:45.402063 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-4b63b5d3-2239-4b5d-ae3b-cd3663cafced tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:51:45.403121 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-4b63b5d3-2239-4b5d-ae3b-cd3663cafced tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 6b648e87-b71a-4ef3-aada-f884b8efb154] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:51:45.410218 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-4b63b5d3-2239-4b5d-ae3b-cd3663cafced tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:45.411175 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-4b63b5d3-2239-4b5d-ae3b-cd3663cafced tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:45.412046 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-4b63b5d3-2239-4b5d-ae3b-cd3663cafced tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:45.412551 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-4b63b5d3-2239-4b5d-ae3b-cd3663cafced tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:45.450151 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-4b63b5d3-2239-4b5d-ae3b-cd3663cafced tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:45.450735 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-4b63b5d3-2239-4b5d-ae3b-cd3663cafced tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:45.451264 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.objects.instance [None req-4b63b5d3-2239-4b5d-ae3b-cd3663cafced tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lazy-loading 'fault' on Instance uuid 6b648e87-b71a-4ef3-aada-f884b8efb154 {{(pid=124669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:51:45.467659 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-a5bbe53e-cc02-43d1-ad62-12d65416ca01 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:51:45.476537 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-a5bbe53e-cc02-43d1-ad62-12d65416ca01 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:51:45.478544 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-a5bbe53e-cc02-43d1-ad62-12d65416ca01 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:51:45.479756 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-a5bbe53e-cc02-43d1-ad62-12d65416ca01 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1720 microversion: 2.20 time: 0.163863 Jun 23 11:51:45.480548 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 426/821] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:51:45 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:51:45.496326 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-4b63b5d3-2239-4b5d-ae3b-cd3663cafced tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:51:45.504508 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-4b63b5d3-2239-4b5d-ae3b-cd3663cafced tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154" status: 200 len: 1335 microversion: 2.1 time: 0.106896 Jun 23 11:51:45.505079 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 396/822] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:51:45 2022] GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154 => generated 1335 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:51:46.499418 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-a250a0fb-8212-49b1-aa6e-58e4c514c19b tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:51:46.500174 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-a250a0fb-8212-49b1-aa6e-58e4c514c19b tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:51:46.506017 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a250a0fb-8212-49b1-aa6e-58e4c514c19b tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:46.511630 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a250a0fb-8212-49b1-aa6e-58e4c514c19b tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:46.511630 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a250a0fb-8212-49b1-aa6e-58e4c514c19b tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:46.511630 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a250a0fb-8212-49b1-aa6e-58e4c514c19b tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:46.523306 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-27431177-b57d-43f2-9cc8-6f588c11e25f tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:51:46.524058 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-27431177-b57d-43f2-9cc8-6f588c11e25f tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 6b648e87-b71a-4ef3-aada-f884b8efb154] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:51:46.531287 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-27431177-b57d-43f2-9cc8-6f588c11e25f tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:46.531788 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-27431177-b57d-43f2-9cc8-6f588c11e25f tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:46.532579 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-27431177-b57d-43f2-9cc8-6f588c11e25f tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:46.533012 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-27431177-b57d-43f2-9cc8-6f588c11e25f tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:46.567994 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-27431177-b57d-43f2-9cc8-6f588c11e25f tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:46.568435 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-27431177-b57d-43f2-9cc8-6f588c11e25f tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:46.568886 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.objects.instance [None req-27431177-b57d-43f2-9cc8-6f588c11e25f tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lazy-loading 'fault' on Instance uuid 6b648e87-b71a-4ef3-aada-f884b8efb154 {{(pid=124669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:51:46.629957 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-27431177-b57d-43f2-9cc8-6f588c11e25f tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:51:46.637601 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-27431177-b57d-43f2-9cc8-6f588c11e25f tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154" status: 200 len: 1335 microversion: 2.1 time: 0.119165 Jun 23 11:51:46.638172 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 397/823] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:51:46 2022] GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154 => generated 1335 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:51:46.665231 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-a250a0fb-8212-49b1-aa6e-58e4c514c19b tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:51:46.673809 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-a250a0fb-8212-49b1-aa6e-58e4c514c19b tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:51:46.675443 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-a250a0fb-8212-49b1-aa6e-58e4c514c19b tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:51:46.676601 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-a250a0fb-8212-49b1-aa6e-58e4c514c19b tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1720 microversion: 2.20 time: 0.181670 Jun 23 11:51:46.677212 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 427/824] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:51:46 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1720 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:51:47.654602 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-ae3754c4-6b9b-4f19-abc9-93ce9fb8f661 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:51:47.655217 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-ae3754c4-6b9b-4f19-abc9-93ce9fb8f661 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 6b648e87-b71a-4ef3-aada-f884b8efb154] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:51:47.661689 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ae3754c4-6b9b-4f19-abc9-93ce9fb8f661 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:47.662140 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ae3754c4-6b9b-4f19-abc9-93ce9fb8f661 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:47.662930 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ae3754c4-6b9b-4f19-abc9-93ce9fb8f661 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:47.663372 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ae3754c4-6b9b-4f19-abc9-93ce9fb8f661 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:47.677712 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.wsgi [None req-ae3754c4-6b9b-4f19-abc9-93ce9fb8f661 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] HTTP exception thrown: Instance 6b648e87-b71a-4ef3-aada-f884b8efb154 could not be found. Jun 23 11:51:47.682576 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-ae3754c4-6b9b-4f19-abc9-93ce9fb8f661 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Request method failure captured: Jun 23 11:51:47.682576 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: request: GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154 HTTP/1.1 Jun 23 11:51:47.682576 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Accept: application/json Jun 23 11:51:47.682576 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Accept-Encoding: identity Jun 23 11:51:47.682576 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Connection: close Jun 23 11:51:47.682576 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Content-Length: 0 Jun 23 11:51:47.682576 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Content-Type: application/json Jun 23 11:51:47.682576 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Host: 10.222.0.13 Jun 23 11:51:47.682576 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Openstack-System-Scope: None Jun 23 11:51:47.682576 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: User-Agent: python-urllib3/1.26.9 Jun 23 11:51:47.682576 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Auth-Token: gAAAAABitFIQMZzIonjUbfDwf8XrsOwiJZRU6mFcRB1-tnfeb_v3NOEweS__m4o1J8UHtu-_xrjURmrJ6fzG89APjTfsnyiQVFAZpTd13GqegTFfQ58YDG0ZJ0-BfSv3ftKHTlhdH_kG2HiseMXvNGBpCdtSjep9DwmxqUcu34-5A9JBS3aKDXY Jun 23 11:51:47.682576 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Domain-Id: None Jun 23 11:51:47.682576 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Domain-Name: None Jun 23 11:51:47.682576 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Identity-Status: Confirmed Jun 23 11:51:47.682576 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Is-Admin-Project: True Jun 23 11:51:47.682576 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Domain-Id: default Jun 23 11:51:47.682576 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Domain-Name: Default Jun 23 11:51:47.682576 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Id: b6241924efa944a68503a87b695c7410 Jun 23 11:51:47.682576 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-493570352 Jun 23 11:51:47.682576 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Role: member,reader Jun 23 11:51:47.682576 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Roles: member,reader Jun 23 11:51:47.684234 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b6241924efa944a68503a87b695c7410"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b6241924efa944a68503a87b695c7410"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b6241924efa944a68503a87b695c7410"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b6241924efa944a68503a87b695c7410"}]}] Jun 23 11:51:47.684234 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant: tempest-ServerRescueNegativeTestJSON-493570352 Jun 23 11:51:47.684234 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant-Id: b6241924efa944a68503a87b695c7410 Jun 23 11:51:47.684234 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-493570352 Jun 23 11:51:47.684234 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User: tempest-ServerRescueNegativeTestJSON-493570352-project Jun 23 11:51:47.684234 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Domain-Id: default Jun 23 11:51:47.684234 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Domain-Name: Default Jun 23 11:51:47.684234 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Id: bcd5fc6167654972868941ed28c327b6 Jun 23 11:51:47.684234 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Name: tempest-ServerRescueNegativeTestJSON-493570352-project Jun 23 11:51:47.684234 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: method: > Jun 23 11:51:47.684234 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: exception: Instance 6b648e87-b71a-4ef3-aada-f884b8efb154 could not be found. Jun 23 11:51:47.684234 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: action_args: {'id': '6b648e87-b71a-4ef3-aada-f884b8efb154'} Jun 23 11:51:47.685050 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:51:47.685050 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:51:47.685050 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:51:47.685050 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:51:47.685050 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:51:47.685050 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:51:47.685050 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:51:47.685050 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:51:47.685050 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:51:47.685050 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:51:47.685050 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b648e87-b71a-4ef3-aada-f884b8efb154 could not be found. Jun 23 11:51:47.685050 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:51:47.685050 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:51:47.685050 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:51:47.685050 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:51:47.685050 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:51:47.685050 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:51:47.685050 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:51:47.685050 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:51:47.685050 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:51:47.687038 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:51:47.687038 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 11:51:47.687038 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 11:51:47.687038 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:51:47.687038 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:51:47.687038 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:51:47.687038 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:51:47.687038 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b648e87-b71a-4ef3-aada-f884b8efb154 could not be found. Jun 23 11:51:47.687038 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:51:47.687038 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:51:47.687038 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:51:47.687038 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:51:47.687038 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:51:47.687038 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:51:47.687038 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:51:47.687038 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:51:47.687038 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b648e87-b71a-4ef3-aada-f884b8efb154 could not be found. Jun 23 11:51:47.687038 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:51:47.688292 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-ae3754c4-6b9b-4f19-abc9-93ce9fb8f661 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Returning 404 to user: Instance 6b648e87-b71a-4ef3-aada-f884b8efb154 could not be found. {{(pid=124669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:51:47.688292 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-ae3754c4-6b9b-4f19-abc9-93ce9fb8f661 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154" status: 404 len: 111 microversion: 2.1 time: 0.030107 Jun 23 11:51:47.688292 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 398/825] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:51:47 2022] GET /compute/v2.1/servers/6b648e87-b71a-4ef3-aada-f884b8efb154 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:51:47.690835 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-a3dd5f1f-44c2-49bf-9282-bd0549e4c8c8 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '.version_select at 0x7f5d067e5b80>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:51:47.694889 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-a842f79f-c0d3-4694-a2ba-123ce108f6fb tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:51:47.695499 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-a842f79f-c0d3-4694-a2ba-123ce108f6fb tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:51:47.701394 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-a842f79f-c0d3-4694-a2ba-123ce108f6fb tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:47.707562 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-a842f79f-c0d3-4694-a2ba-123ce108f6fb tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:47.707562 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-a842f79f-c0d3-4694-a2ba-123ce108f6fb tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:47.707562 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-a842f79f-c0d3-4694-a2ba-123ce108f6fb tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:47.816214 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-a3dd5f1f-44c2-49bf-9282-bd0549e4c8c8 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-241774240" status: 202 len: 0 microversion: 2.1 time: 0.130196 Jun 23 11:51:47.816802 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 428/826] 10.222.0.13 () {58 vars in 1217 bytes} [Thu Jun 23 11:51:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-241774240 => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 11:51:47.901027 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-a842f79f-c0d3-4694-a2ba-123ce108f6fb tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:51:47.909731 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-a842f79f-c0d3-4694-a2ba-123ce108f6fb tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:51:47.911473 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-a842f79f-c0d3-4694-a2ba-123ce108f6fb tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:51:47.912646 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-a842f79f-c0d3-4694-a2ba-123ce108f6fb tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1720 microversion: 2.20 time: 0.221482 Jun 23 11:51:47.913368 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 399/827] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:51:47 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1720 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:51:48.142856 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [req-d10795ab-b443-4c4f-babb-e8912c7ee0cb req-3142f3c9-c6d5-4791-82bd-d6f9bb9e6c52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9e98590-5036-4ade-bbba-f743256ac961", "name": "network-vif-deleted", "tag": "ff54d5bf-cdc7-493b-be07-f5ca28b2681b"}]} {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:51:48.164132 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-d10795ab-b443-4c4f-babb-e8912c7ee0cb req-3142f3c9-c6d5-4791-82bd-d6f9bb9e6c52 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:48.164693 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-d10795ab-b443-4c4f-babb-e8912c7ee0cb req-3142f3c9-c6d5-4791-82bd-d6f9bb9e6c52 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:48.181990 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.compute.server_external_events [req-d10795ab-b443-4c4f-babb-e8912c7ee0cb req-3142f3c9-c6d5-4791-82bd-d6f9bb9e6c52 service nova] Creating event network-vif-deleted:ff54d5bf-cdc7-493b-be07-f5ca28b2681b for instance d9e98590-5036-4ade-bbba-f743256ac961 on hv-cinder-82099 Jun 23 11:51:48.188439 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [req-d10795ab-b443-4c4f-babb-e8912c7ee0cb req-3142f3c9-c6d5-4791-82bd-d6f9bb9e6c52 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049456 Jun 23 11:51:48.190463 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 429/828] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:51:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:51:48.931756 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-74515ec0-d18b-4fcc-b78b-8f4c3a63c83b tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:51:48.933160 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-74515ec0-d18b-4fcc-b78b-8f4c3a63c83b tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:51:48.943181 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-74515ec0-d18b-4fcc-b78b-8f4c3a63c83b tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:48.943622 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-74515ec0-d18b-4fcc-b78b-8f4c3a63c83b tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:48.944505 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-74515ec0-d18b-4fcc-b78b-8f4c3a63c83b tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:48.944945 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-74515ec0-d18b-4fcc-b78b-8f4c3a63c83b tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:48.979357 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-74515ec0-d18b-4fcc-b78b-8f4c3a63c83b tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:48.979873 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-74515ec0-d18b-4fcc-b78b-8f4c3a63c83b tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:48.980389 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.objects.instance [None req-74515ec0-d18b-4fcc-b78b-8f4c3a63c83b tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lazy-loading 'fault' on Instance uuid d9e98590-5036-4ade-bbba-f743256ac961 {{(pid=124669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:51:49.024837 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-74515ec0-d18b-4fcc-b78b-8f4c3a63c83b tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:51:49.037418 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-74515ec0-d18b-4fcc-b78b-8f4c3a63c83b tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:51:49.038936 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-74515ec0-d18b-4fcc-b78b-8f4c3a63c83b tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:51:49.040104 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-74515ec0-d18b-4fcc-b78b-8f4c3a63c83b tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 200 len: 1370 microversion: 2.20 time: 0.112799 Jun 23 11:51:49.040711 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 400/829] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:51:48 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 1370 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:51:50.060482 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-fb7a1160-4ba5-40f4-97ae-a01ce65267c3 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:51:50.061188 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-fb7a1160-4ba5-40f4-97ae-a01ce65267c3 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:51:50.067614 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-fb7a1160-4ba5-40f4-97ae-a01ce65267c3 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:50.068066 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-fb7a1160-4ba5-40f4-97ae-a01ce65267c3 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:50.068821 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-fb7a1160-4ba5-40f4-97ae-a01ce65267c3 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:50.069256 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-fb7a1160-4ba5-40f4-97ae-a01ce65267c3 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:50.087227 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.wsgi [None req-fb7a1160-4ba5-40f4-97ae-a01ce65267c3 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] HTTP exception thrown: Instance d9e98590-5036-4ade-bbba-f743256ac961 could not be found. Jun 23 11:51:50.088023 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-fb7a1160-4ba5-40f4-97ae-a01ce65267c3 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Request method failure captured: Jun 23 11:51:50.088023 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: request: GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 HTTP/1.1 Jun 23 11:51:50.088023 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Accept: application/json Jun 23 11:51:50.088023 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Accept-Encoding: identity Jun 23 11:51:50.088023 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Connection: close Jun 23 11:51:50.088023 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Content-Length: 0 Jun 23 11:51:50.088023 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Content-Type: application/json Jun 23 11:51:50.088023 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Host: 10.222.0.13 Jun 23 11:51:50.088023 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Openstack-System-Scope: None Jun 23 11:51:50.088023 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: User-Agent: python-urllib3/1.26.9 Jun 23 11:51:50.088023 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Auth-Token: gAAAAABitFKDO5UVobueQEQJ2YUHyncwckPaMgzyz_wvVEuptm8ae8DuBcodoQfFFPUmC1_B0Lg7tYFC0jL381L-1yVrhssvsKzevNvrbuMLiy9lOFiuw0Q1_NfG6KuVGkpedL76osllJXZ4E_neeeSEGUBNvd0Sh_8DFxFul8ZEUwsfBt9U_Hc Jun 23 11:51:50.088023 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Domain-Id: None Jun 23 11:51:50.088023 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Domain-Name: None Jun 23 11:51:50.088023 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Identity-Status: Confirmed Jun 23 11:51:50.088023 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Is-Admin-Project: True Jun 23 11:51:50.088023 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Openstack-Nova-Api-Version: 2.20 Jun 23 11:51:50.088023 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Domain-Id: default Jun 23 11:51:50.088023 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Domain-Name: Default Jun 23 11:51:50.088023 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Id: 4c0275f5304e4d9eae19c46a4f161217 Jun 23 11:51:50.088023 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1670293014 Jun 23 11:51:50.088023 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Role: member,reader Jun 23 11:51:50.088023 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Roles: member,reader Jun 23 11:51:50.089643 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4c0275f5304e4d9eae19c46a4f161217"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4c0275f5304e4d9eae19c46a4f161217"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4c0275f5304e4d9eae19c46a4f161217"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4c0275f5304e4d9eae19c46a4f161217"}]}] Jun 23 11:51:50.089643 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1670293014 Jun 23 11:51:50.089643 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Tenant-Id: 4c0275f5304e4d9eae19c46a4f161217 Jun 23 11:51:50.089643 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1670293014 Jun 23 11:51:50.089643 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User: tempest-AttachVolumeShelveTestJSON-1670293014-project Jun 23 11:51:50.089643 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Domain-Id: default Jun 23 11:51:50.089643 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Domain-Name: Default Jun 23 11:51:50.089643 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Id: 41cb2b9a5156470aaeca9cc10f402ef9 Jun 23 11:51:50.089643 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1670293014-project Jun 23 11:51:50.089643 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: method: > Jun 23 11:51:50.089643 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: exception: Instance d9e98590-5036-4ade-bbba-f743256ac961 could not be found. Jun 23 11:51:50.089643 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: action_args: {'id': 'd9e98590-5036-4ade-bbba-f743256ac961'} Jun 23 11:51:50.090688 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:51:50.090688 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:51:50.090688 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:51:50.090688 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:51:50.090688 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:51:50.090688 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:51:50.090688 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:51:50.090688 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:51:50.090688 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:51:50.090688 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:51:50.090688 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9e98590-5036-4ade-bbba-f743256ac961 could not be found. Jun 23 11:51:50.090688 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:51:50.090688 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:51:50.090688 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:51:50.090688 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:51:50.090688 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:51:50.090688 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:51:50.090688 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:51:50.090688 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:51:50.090688 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:51:50.092116 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:51:50.092116 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 11:51:50.092116 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 11:51:50.092116 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:51:50.092116 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:51:50.092116 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:51:50.092116 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:51:50.092116 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9e98590-5036-4ade-bbba-f743256ac961 could not be found. Jun 23 11:51:50.092116 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:51:50.092116 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:51:50.092116 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:51:50.092116 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:51:50.092116 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:51:50.092116 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:51:50.092116 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:51:50.092116 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:51:50.092116 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9e98590-5036-4ade-bbba-f743256ac961 could not be found. Jun 23 11:51:50.092116 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:51:50.094934 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-fb7a1160-4ba5-40f4-97ae-a01ce65267c3 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Returning 404 to user: Instance d9e98590-5036-4ade-bbba-f743256ac961 could not be found. {{(pid=124670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:51:50.094934 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-fb7a1160-4ba5-40f4-97ae-a01ce65267c3 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 404 len: 111 microversion: 2.20 time: 0.033375 Jun 23 11:51:50.094934 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 430/830] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:51:50 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 23 11:51:50.099243 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-1a574622-b76c-46a4-8662-3d7f9796d4ae tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '.version_select at 0x7f5d0650a820>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:51:50.181651 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-1a574622-b76c-46a4-8662-3d7f9796d4ae tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-834820437" status: 204 len: 0 microversion: 2.20 time: 0.086331 Jun 23 11:51:50.182178 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 401/831] 10.222.0.13 () {60 vars in 1258 bytes} [Thu Jun 23 11:51:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-834820437 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 23 11:51:50.995071 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-3671c568-d00a-47d6-8ce5-5128725ab1fa tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Action: 'create', calling method: .version_select at 0x7f5d067e5af0>, body: {"keypair": {"name": "tempest-keypair-741569791", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFVt5aWs9ae3bBdGwRE1q2ijTvf+tA8eF6vwkDJVRwJDO29p6ZbyfjWbSclDIA1QahwlRJq7OO8LpJJvb4WVmAc2HDGtlrVyRO3eEGBbWRTsoTFMqT/pNO/aFNR9aFX/0Q=="}} {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:51:51.010270 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.quota [None req-3671c568-d00a-47d6-8ce5-5128725ab1fa tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Getting quotas for project 4c0275f5304e4d9eae19c46a4f161217. Resources: {'key_pairs'} {{(pid=124670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:51:51.014193 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.quota [None req-3671c568-d00a-47d6-8ce5-5128725ab1fa tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Getting quotas for user 41cb2b9a5156470aaeca9cc10f402ef9 and project 4c0275f5304e4d9eae19c46a4f161217. Resources: {'key_pairs'} {{(pid=124670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:51:51.093311 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-3671c568-d00a-47d6-8ce5-5128725ab1fa tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.101587 Jun 23 11:51:51.094291 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 431/832] 10.222.0.13 () {62 vars in 1199 bytes} [Thu Jun 23 11:51:50 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 103 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 23 11:51:51.158982 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-6ac268d3-4b47-4e4c-af76-692002fa74dc tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:51:51.159460 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-6ac268d3-4b47-4e4c-af76-692002fa74dc tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 0953fa06-0916-418f-b527-06d088cc6066] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:51:51.166091 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-6ac268d3-4b47-4e4c-af76-692002fa74dc tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:51.166565 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-6ac268d3-4b47-4e4c-af76-692002fa74dc tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:51.167332 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-6ac268d3-4b47-4e4c-af76-692002fa74dc tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:51.167765 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-6ac268d3-4b47-4e4c-af76-692002fa74dc tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:51.193090 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-6ac268d3-4b47-4e4c-af76-692002fa74dc tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 0953fa06-0916-418f-b527-06d088cc6066] Going to try to terminate instance {{(pid=124669) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 11:51:51.208531 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:51:51.509596 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-6ac268d3-4b47-4e4c-af76-692002fa74dc tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "DELETE /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066" status: 204 len: 0 microversion: 2.1 time: 0.356017 Jun 23 11:51:51.510202 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 402/833] 10.222.0.13 () {58 vars in 1238 bytes} [Thu Jun 23 11:51:51 2022] DELETE /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 11:51:51.519078 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-724407b3-fd21-43e1-9ef4-1b1e6469be56 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:51:51.519691 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-724407b3-fd21-43e1-9ef4-1b1e6469be56 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 0953fa06-0916-418f-b527-06d088cc6066] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:51:51.525832 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-724407b3-fd21-43e1-9ef4-1b1e6469be56 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:51.528820 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-724407b3-fd21-43e1-9ef4-1b1e6469be56 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:51.528820 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-724407b3-fd21-43e1-9ef4-1b1e6469be56 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:51.528820 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-724407b3-fd21-43e1-9ef4-1b1e6469be56 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:51.690553 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-724407b3-fd21-43e1-9ef4-1b1e6469be56 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:51:51.698082 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-724407b3-fd21-43e1-9ef4-1b1e6469be56 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066" status: 200 len: 1508 microversion: 2.1 time: 0.183706 Jun 23 11:51:51.698667 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 432/834] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:51:51 2022] GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066 => generated 1508 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:51:52.716968 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-33d6c62e-e6b5-4538-b22b-d98b8514d3f3 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:51:52.718631 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-33d6c62e-e6b5-4538-b22b-d98b8514d3f3 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 0953fa06-0916-418f-b527-06d088cc6066] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:51:52.726664 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-33d6c62e-e6b5-4538-b22b-d98b8514d3f3 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:52.728014 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-33d6c62e-e6b5-4538-b22b-d98b8514d3f3 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:52.728794 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-33d6c62e-e6b5-4538-b22b-d98b8514d3f3 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:52.729234 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-33d6c62e-e6b5-4538-b22b-d98b8514d3f3 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:53.248555 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-33d6c62e-e6b5-4538-b22b-d98b8514d3f3 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:51:53.256993 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-33d6c62e-e6b5-4538-b22b-d98b8514d3f3 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066" status: 200 len: 1508 microversion: 2.1 time: 0.544593 Jun 23 11:51:53.257574 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 403/835] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:51:52 2022] GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066 => generated 1508 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:51:53.524838 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [req-1152d721-c0c6-470f-9ae7-9df549278fed req-dc52b03e-5e8e-49c7-8680-b5b1b5a274a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0953fa06-0916-418f-b527-06d088cc6066", "name": "network-vif-deleted", "tag": "56dc5915-6e20-441e-8915-6463dfb576ba"}]} {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:51:53.536001 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-1152d721-c0c6-470f-9ae7-9df549278fed req-dc52b03e-5e8e-49c7-8680-b5b1b5a274a7 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:53.537262 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-1152d721-c0c6-470f-9ae7-9df549278fed req-dc52b03e-5e8e-49c7-8680-b5b1b5a274a7 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:53.549707 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.compute.server_external_events [req-1152d721-c0c6-470f-9ae7-9df549278fed req-dc52b03e-5e8e-49c7-8680-b5b1b5a274a7 service nova] Creating event network-vif-deleted:56dc5915-6e20-441e-8915-6463dfb576ba for instance 0953fa06-0916-418f-b527-06d088cc6066 on hv-cinder-82099 Jun 23 11:51:53.554726 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [req-1152d721-c0c6-470f-9ae7-9df549278fed req-dc52b03e-5e8e-49c7-8680-b5b1b5a274a7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036059 Jun 23 11:51:53.555530 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 433/836] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:51:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:51:54.149947 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-ae931aad-6938-4a1b-b614-8ecc66671d63 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1327102692", "imageRef": "b19d6f23-214c-4432-bee6-455978023759", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f03946f1-997c-47c6-9ad6-e4221a2ca301"}], "security_groups": [{"name": "tempest-securitygroup--2067304105"}], "key_name": "tempest-keypair-741569791", "user_data": "}} {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:51:54.255411 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.network.neutron [None req-ae931aad-6938-4a1b-b614-8ecc66671d63 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] validate_networks() for [('f03946f1-997c-47c6-9ad6-e4221a2ca301', None, None, None, None, None)] {{(pid=124669) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 11:51:54.273779 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-f7d76c75-8edc-4294-8645-4d39f3cbe2ec tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:51:54.274665 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-f7d76c75-8edc-4294-8645-4d39f3cbe2ec tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 0953fa06-0916-418f-b527-06d088cc6066] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:51:54.281141 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-f7d76c75-8edc-4294-8645-4d39f3cbe2ec tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:54.285443 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-f7d76c75-8edc-4294-8645-4d39f3cbe2ec tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:54.285443 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-f7d76c75-8edc-4294-8645-4d39f3cbe2ec tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:54.285443 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-f7d76c75-8edc-4294-8645-4d39f3cbe2ec tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:54.314694 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-f7d76c75-8edc-4294-8645-4d39f3cbe2ec tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:54.315142 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-f7d76c75-8edc-4294-8645-4d39f3cbe2ec tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:54.315588 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.objects.instance [None req-f7d76c75-8edc-4294-8645-4d39f3cbe2ec tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lazy-loading 'fault' on Instance uuid 0953fa06-0916-418f-b527-06d088cc6066 {{(pid=124670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:51:54.369832 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-f7d76c75-8edc-4294-8645-4d39f3cbe2ec tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:51:54.378359 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-f7d76c75-8edc-4294-8645-4d39f3cbe2ec tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066" status: 200 len: 1312 microversion: 2.1 time: 0.108826 Jun 23 11:51:54.387756 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 434/837] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:51:54 2022] GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066 => generated 1312 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:51:54.713624 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.virt.hardware [None req-ae931aad-6938-4a1b-b614-8ecc66671d63 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Flavor limits 0:0:0 {{(pid=124669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 11:51:54.714049 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.virt.hardware [None req-ae931aad-6938-4a1b-b614-8ecc66671d63 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Image limits 0:0:0 {{(pid=124669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 11:51:54.714524 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.virt.hardware [None req-ae931aad-6938-4a1b-b614-8ecc66671d63 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Flavor pref 0:0:0 {{(pid=124669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 11:51:54.714969 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.virt.hardware [None req-ae931aad-6938-4a1b-b614-8ecc66671d63 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Image pref 0:0:0 {{(pid=124669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 11:51:54.715378 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.virt.hardware [None req-ae931aad-6938-4a1b-b614-8ecc66671d63 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 11:51:54.725192 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ae931aad-6938-4a1b-b614-8ecc66671d63 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:54.725637 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ae931aad-6938-4a1b-b614-8ecc66671d63 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:54.726425 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ae931aad-6938-4a1b-b614-8ecc66671d63 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:54.726931 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ae931aad-6938-4a1b-b614-8ecc66671d63 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:54.744255 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.quota [None req-ae931aad-6938-4a1b-b614-8ecc66671d63 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Getting quotas for project 4c0275f5304e4d9eae19c46a4f161217. Resources: {'cores', 'instances', 'ram'} {{(pid=124669) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:51:54.748386 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.quota [None req-ae931aad-6938-4a1b-b614-8ecc66671d63 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Getting quotas for user 41cb2b9a5156470aaeca9cc10f402ef9 and project 4c0275f5304e4d9eae19c46a4f161217. Resources: {'cores', 'instances', 'ram'} {{(pid=124669) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:51:54.759353 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-ae931aad-6938-4a1b-b614-8ecc66671d63 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Going to run 1 instances... {{(pid=124669) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 11:51:54.761686 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-ae931aad-6938-4a1b-b614-8ecc66671d63 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b19d6f23-214c-4432-bee6-455978023759',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124669) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 11:51:54.873582 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-ae931aad-6938-4a1b-b614-8ecc66671d63 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.727926 Jun 23 11:51:54.874637 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 404/838] 10.222.0.13 () {62 vars in 1187 bytes} [Thu Jun 23 11:51:54 2022] POST /compute/v2.1/servers => generated 402 bytes in 729 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 23 11:51:54.884457 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-39c61161-630f-4784-bf54-0301d5e55c81 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:51:54.885068 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-39c61161-630f-4784-bf54-0301d5e55c81 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:51:54.936866 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-39c61161-630f-4784-bf54-0301d5e55c81 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:51:54.944179 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-39c61161-630f-4784-bf54-0301d5e55c81 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:51:54.945680 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-39c61161-630f-4784-bf54-0301d5e55c81 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:51:54.946802 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-39c61161-630f-4784-bf54-0301d5e55c81 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143" status: 200 len: 1281 microversion: 2.20 time: 0.066304 Jun 23 11:51:54.947357 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 435/839] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:51:54 2022] GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 => generated 1281 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:51:55.396312 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-9e277fe1-20b2-48e1-9a87-e7e1800c26b5 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:51:55.396923 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-9e277fe1-20b2-48e1-9a87-e7e1800c26b5 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 0953fa06-0916-418f-b527-06d088cc6066] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:51:55.403078 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-9e277fe1-20b2-48e1-9a87-e7e1800c26b5 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:55.403528 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-9e277fe1-20b2-48e1-9a87-e7e1800c26b5 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:55.404284 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-9e277fe1-20b2-48e1-9a87-e7e1800c26b5 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:55.404719 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-9e277fe1-20b2-48e1-9a87-e7e1800c26b5 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:55.418450 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.wsgi [None req-9e277fe1-20b2-48e1-9a87-e7e1800c26b5 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] HTTP exception thrown: Instance 0953fa06-0916-418f-b527-06d088cc6066 could not be found. Jun 23 11:51:55.420095 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-9e277fe1-20b2-48e1-9a87-e7e1800c26b5 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Request method failure captured: Jun 23 11:51:55.420095 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: request: GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066 HTTP/1.1 Jun 23 11:51:55.420095 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Accept: application/json Jun 23 11:51:55.420095 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Accept-Encoding: identity Jun 23 11:51:55.420095 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Connection: close Jun 23 11:51:55.420095 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Content-Length: 0 Jun 23 11:51:55.420095 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Content-Type: application/json Jun 23 11:51:55.420095 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Host: 10.222.0.13 Jun 23 11:51:55.420095 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Openstack-System-Scope: None Jun 23 11:51:55.420095 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: User-Agent: python-urllib3/1.26.9 Jun 23 11:51:55.420095 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Auth-Token: gAAAAABitFIQMZzIonjUbfDwf8XrsOwiJZRU6mFcRB1-tnfeb_v3NOEweS__m4o1J8UHtu-_xrjURmrJ6fzG89APjTfsnyiQVFAZpTd13GqegTFfQ58YDG0ZJ0-BfSv3ftKHTlhdH_kG2HiseMXvNGBpCdtSjep9DwmxqUcu34-5A9JBS3aKDXY Jun 23 11:51:55.420095 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Domain-Id: None Jun 23 11:51:55.420095 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Domain-Name: None Jun 23 11:51:55.420095 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Identity-Status: Confirmed Jun 23 11:51:55.420095 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Is-Admin-Project: True Jun 23 11:51:55.420095 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Domain-Id: default Jun 23 11:51:55.420095 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Domain-Name: Default Jun 23 11:51:55.420095 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Id: b6241924efa944a68503a87b695c7410 Jun 23 11:51:55.420095 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-493570352 Jun 23 11:51:55.420095 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Role: member,reader Jun 23 11:51:55.420095 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Roles: member,reader Jun 23 11:51:55.421786 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b6241924efa944a68503a87b695c7410"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b6241924efa944a68503a87b695c7410"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b6241924efa944a68503a87b695c7410"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b6241924efa944a68503a87b695c7410"}]}] Jun 23 11:51:55.421786 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant: tempest-ServerRescueNegativeTestJSON-493570352 Jun 23 11:51:55.421786 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant-Id: b6241924efa944a68503a87b695c7410 Jun 23 11:51:55.421786 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-493570352 Jun 23 11:51:55.421786 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User: tempest-ServerRescueNegativeTestJSON-493570352-project Jun 23 11:51:55.421786 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Domain-Id: default Jun 23 11:51:55.421786 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Domain-Name: Default Jun 23 11:51:55.421786 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Id: bcd5fc6167654972868941ed28c327b6 Jun 23 11:51:55.421786 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Name: tempest-ServerRescueNegativeTestJSON-493570352-project Jun 23 11:51:55.421786 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: method: > Jun 23 11:51:55.421786 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: exception: Instance 0953fa06-0916-418f-b527-06d088cc6066 could not be found. Jun 23 11:51:55.421786 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: action_args: {'id': '0953fa06-0916-418f-b527-06d088cc6066'} Jun 23 11:51:55.422840 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:51:55.422840 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:51:55.422840 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:51:55.422840 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:51:55.422840 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:51:55.422840 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:51:55.422840 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:51:55.422840 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:51:55.422840 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:51:55.422840 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:51:55.422840 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0953fa06-0916-418f-b527-06d088cc6066 could not be found. Jun 23 11:51:55.422840 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:51:55.422840 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:51:55.422840 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:51:55.422840 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:51:55.422840 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:51:55.422840 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:51:55.422840 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:51:55.422840 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:51:55.422840 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:51:55.424276 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:51:55.424276 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 11:51:55.424276 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 11:51:55.424276 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:51:55.424276 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:51:55.424276 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:51:55.424276 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:51:55.424276 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0953fa06-0916-418f-b527-06d088cc6066 could not be found. Jun 23 11:51:55.424276 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:51:55.424276 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:51:55.424276 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:51:55.424276 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:51:55.424276 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:51:55.424276 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:51:55.424276 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:51:55.424276 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:51:55.424276 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0953fa06-0916-418f-b527-06d088cc6066 could not be found. Jun 23 11:51:55.424276 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:51:55.425929 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-9e277fe1-20b2-48e1-9a87-e7e1800c26b5 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Returning 404 to user: Instance 0953fa06-0916-418f-b527-06d088cc6066 could not be found. {{(pid=124669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:51:55.425929 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-9e277fe1-20b2-48e1-9a87-e7e1800c26b5 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066" status: 404 len: 111 microversion: 2.1 time: 0.029653 Jun 23 11:51:55.425929 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 405/840] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:51:55 2022] GET /compute/v2.1/servers/0953fa06-0916-418f-b527-06d088cc6066 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:51:55.429924 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-d23ee0d4-6798-4e54-b0a5-5a75abd612c8 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:51:55.430415 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-d23ee0d4-6798-4e54-b0a5-5a75abd612c8 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 762e880e-7ec3-41bb-aac7-fa05de4efd11] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:51:55.437064 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-d23ee0d4-6798-4e54-b0a5-5a75abd612c8 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:55.437520 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-d23ee0d4-6798-4e54-b0a5-5a75abd612c8 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:55.438337 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-d23ee0d4-6798-4e54-b0a5-5a75abd612c8 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:55.438746 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-d23ee0d4-6798-4e54-b0a5-5a75abd612c8 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:55.454498 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:51:55.464684 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-d23ee0d4-6798-4e54-b0a5-5a75abd612c8 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 762e880e-7ec3-41bb-aac7-fa05de4efd11] Going to try to terminate instance {{(pid=124670) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 11:51:55.741048 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-d23ee0d4-6798-4e54-b0a5-5a75abd612c8 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "DELETE /compute/v2.1/servers/762e880e-7ec3-41bb-aac7-fa05de4efd11" status: 204 len: 0 microversion: 2.1 time: 0.314641 Jun 23 11:51:55.741637 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 436/841] 10.222.0.13 () {58 vars in 1238 bytes} [Thu Jun 23 11:51:55 2022] DELETE /compute/v2.1/servers/762e880e-7ec3-41bb-aac7-fa05de4efd11 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 11:51:55.750636 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-2147f6cb-21e0-4596-a465-1da6649a1106 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:51:55.751245 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-2147f6cb-21e0-4596-a465-1da6649a1106 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 762e880e-7ec3-41bb-aac7-fa05de4efd11] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:51:55.757253 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-2147f6cb-21e0-4596-a465-1da6649a1106 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:55.757701 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-2147f6cb-21e0-4596-a465-1da6649a1106 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:55.758452 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-2147f6cb-21e0-4596-a465-1da6649a1106 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:55.758906 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-2147f6cb-21e0-4596-a465-1da6649a1106 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:55.892006 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-2147f6cb-21e0-4596-a465-1da6649a1106 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:51:55.900064 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-2147f6cb-21e0-4596-a465-1da6649a1106 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/762e880e-7ec3-41bb-aac7-fa05de4efd11" status: 200 len: 1521 microversion: 2.1 time: 0.153638 Jun 23 11:51:55.900210 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 406/842] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:51:55 2022] GET /compute/v2.1/servers/762e880e-7ec3-41bb-aac7-fa05de4efd11 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:51:55.964205 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-cbd20346-2225-4dca-a47c-b126c7d1ef3f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:51:55.964815 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-cbd20346-2225-4dca-a47c-b126c7d1ef3f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:51:55.970894 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-cbd20346-2225-4dca-a47c-b126c7d1ef3f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:55.971336 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-cbd20346-2225-4dca-a47c-b126c7d1ef3f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:55.972351 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-cbd20346-2225-4dca-a47c-b126c7d1ef3f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:55.972765 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-cbd20346-2225-4dca-a47c-b126c7d1ef3f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:56.035814 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-cbd20346-2225-4dca-a47c-b126c7d1ef3f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:51:56.044025 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-cbd20346-2225-4dca-a47c-b126c7d1ef3f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:51:56.048291 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-cbd20346-2225-4dca-a47c-b126c7d1ef3f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:51:56.048291 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-cbd20346-2225-4dca-a47c-b126c7d1ef3f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143" status: 200 len: 1285 microversion: 2.20 time: 0.087428 Jun 23 11:51:56.048291 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 437/843] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:51:55 2022] GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 => generated 1285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:51:56.917227 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-2db74841-650a-42ce-bff1-97672480b2a0 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:51:56.918045 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-2db74841-650a-42ce-bff1-97672480b2a0 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 762e880e-7ec3-41bb-aac7-fa05de4efd11] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:51:56.924834 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-2db74841-650a-42ce-bff1-97672480b2a0 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:56.925293 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-2db74841-650a-42ce-bff1-97672480b2a0 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:56.926292 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-2db74841-650a-42ce-bff1-97672480b2a0 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:56.926767 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-2db74841-650a-42ce-bff1-97672480b2a0 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:57.066174 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-7a2f27d7-6773-4367-855b-5c38eecdf6eb tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:51:57.067439 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-7a2f27d7-6773-4367-855b-5c38eecdf6eb tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:51:57.073520 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-7a2f27d7-6773-4367-855b-5c38eecdf6eb tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:57.073965 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-7a2f27d7-6773-4367-855b-5c38eecdf6eb tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:57.074764 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-7a2f27d7-6773-4367-855b-5c38eecdf6eb tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:57.075192 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-7a2f27d7-6773-4367-855b-5c38eecdf6eb tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:57.161510 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-2db74841-650a-42ce-bff1-97672480b2a0 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:51:57.162102 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-7a2f27d7-6773-4367-855b-5c38eecdf6eb tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:51:57.175127 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-7a2f27d7-6773-4367-855b-5c38eecdf6eb tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:51:57.175994 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-2db74841-650a-42ce-bff1-97672480b2a0 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/762e880e-7ec3-41bb-aac7-fa05de4efd11" status: 200 len: 1521 microversion: 2.1 time: 0.262618 Jun 23 11:51:57.176577 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 407/844] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:51:56 2022] GET /compute/v2.1/servers/762e880e-7ec3-41bb-aac7-fa05de4efd11 => generated 1521 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:51:57.182118 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-7a2f27d7-6773-4367-855b-5c38eecdf6eb tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:51:57.185324 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-7a2f27d7-6773-4367-855b-5c38eecdf6eb tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143" status: 200 len: 1341 microversion: 2.20 time: 0.124078 Jun 23 11:51:57.191157 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 438/845] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:51:57 2022] GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 => generated 1341 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:51:57.388644 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [req-ddf7d066-1783-485c-9284-3aa9783ff0f4 req-ba747b18-748e-46b9-90d4-2a62b820a9f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "762e880e-7ec3-41bb-aac7-fa05de4efd11", "name": "network-vif-deleted", "tag": "6fce142e-835a-4a3c-9803-6bb673a86c29"}]} {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:51:57.398505 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [req-ddf7d066-1783-485c-9284-3aa9783ff0f4 req-ba747b18-748e-46b9-90d4-2a62b820a9f8 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:57.399217 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [req-ddf7d066-1783-485c-9284-3aa9783ff0f4 req-ba747b18-748e-46b9-90d4-2a62b820a9f8 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:57.411059 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.compute.server_external_events [req-ddf7d066-1783-485c-9284-3aa9783ff0f4 req-ba747b18-748e-46b9-90d4-2a62b820a9f8 service nova] Creating event network-vif-deleted:6fce142e-835a-4a3c-9803-6bb673a86c29 for instance 762e880e-7ec3-41bb-aac7-fa05de4efd11 on hv-cinder-82099 Jun 23 11:51:57.416693 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [req-ddf7d066-1783-485c-9284-3aa9783ff0f4 req-ba747b18-748e-46b9-90d4-2a62b820a9f8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031763 Jun 23 11:51:57.418111 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 408/846] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:51:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:51:57.654277 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-8a54faec-9dfc-44da-b0c1-362c7c276f87 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:51:57.656595 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-8a54faec-9dfc-44da-b0c1-362c7c276f87 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:51:57.663448 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-8a54faec-9dfc-44da-b0c1-362c7c276f87 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:57.664621 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-8a54faec-9dfc-44da-b0c1-362c7c276f87 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:57.665609 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-8a54faec-9dfc-44da-b0c1-362c7c276f87 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:57.666124 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-8a54faec-9dfc-44da-b0c1-362c7c276f87 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:57.699596 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-8a54faec-9dfc-44da-b0c1-362c7c276f87 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049427 Jun 23 11:51:57.700406 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 439/847] 10.222.0.13 () {58 vars in 1301 bytes} [Thu Jun 23 11:51:57 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 11:51:57.770772 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-c7a881ee-794c-4830-899a-56c25c9f7cb8 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:51:57.771496 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-c7a881ee-794c-4830-899a-56c25c9f7cb8 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:51:57.778314 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c7a881ee-794c-4830-899a-56c25c9f7cb8 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:57.778989 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c7a881ee-794c-4830-899a-56c25c9f7cb8 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:57.779841 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c7a881ee-794c-4830-899a-56c25c9f7cb8 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:57.780881 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c7a881ee-794c-4830-899a-56c25c9f7cb8 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:57.810895 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-c7a881ee-794c-4830-899a-56c25c9f7cb8 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Going to try to terminate instance {{(pid=124669) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 11:51:58.070549 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-c7a881ee-794c-4830-899a-56c25c9f7cb8 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "DELETE /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 204 len: 0 microversion: 2.1 time: 0.303769 Jun 23 11:51:58.072608 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 409/848] 10.222.0.13 () {58 vars in 1238 bytes} [Thu Jun 23 11:51:57 2022] DELETE /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 11:51:58.082220 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-69c3c30a-db6f-4ff8-9f30-4787e5950450 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:51:58.083342 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-69c3c30a-db6f-4ff8-9f30-4787e5950450 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:51:58.089626 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-69c3c30a-db6f-4ff8-9f30-4787e5950450 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:58.090298 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-69c3c30a-db6f-4ff8-9f30-4787e5950450 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:58.091251 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-69c3c30a-db6f-4ff8-9f30-4787e5950450 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:58.091874 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-69c3c30a-db6f-4ff8-9f30-4787e5950450 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:58.193827 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-20ad1d99-e59a-4ad0-a613-1674a247d17c tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:51:58.194748 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-20ad1d99-e59a-4ad0-a613-1674a247d17c tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 762e880e-7ec3-41bb-aac7-fa05de4efd11] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:51:58.203618 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-20ad1d99-e59a-4ad0-a613-1674a247d17c tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:58.204202 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-20ad1d99-e59a-4ad0-a613-1674a247d17c tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:58.205519 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-20ad1d99-e59a-4ad0-a613-1674a247d17c tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:58.206176 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-20ad1d99-e59a-4ad0-a613-1674a247d17c tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:58.262956 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-69c3c30a-db6f-4ff8-9f30-4787e5950450 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:51:58.272417 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-69c3c30a-db6f-4ff8-9f30-4787e5950450 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 200 len: 1676 microversion: 2.1 time: 0.195837 Jun 23 11:51:58.273010 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 440/849] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:51:58 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 1676 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:51:58.279557 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-4d98c85c-8897-427e-b3ea-53c734faa951 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:51:58.281087 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-4d98c85c-8897-427e-b3ea-53c734faa951 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:51:58.287975 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-4d98c85c-8897-427e-b3ea-53c734faa951 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:58.288573 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-4d98c85c-8897-427e-b3ea-53c734faa951 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:58.289562 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-4d98c85c-8897-427e-b3ea-53c734faa951 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:58.290000 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-4d98c85c-8897-427e-b3ea-53c734faa951 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:58.411276 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-20ad1d99-e59a-4ad0-a613-1674a247d17c tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:58.412041 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-20ad1d99-e59a-4ad0-a613-1674a247d17c tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:58.412752 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.objects.instance [None req-20ad1d99-e59a-4ad0-a613-1674a247d17c tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lazy-loading 'fault' on Instance uuid 762e880e-7ec3-41bb-aac7-fa05de4efd11 {{(pid=124669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:51:58.449529 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-4d98c85c-8897-427e-b3ea-53c734faa951 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:51:58.458752 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-4d98c85c-8897-427e-b3ea-53c734faa951 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:51:58.460284 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-4d98c85c-8897-427e-b3ea-53c734faa951 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:51:58.461432 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-4d98c85c-8897-427e-b3ea-53c734faa951 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143" status: 200 len: 1407 microversion: 2.20 time: 0.187262 Jun 23 11:51:58.462013 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 441/850] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:51:58 2022] GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 => generated 1407 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:51:58.470270 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-20ad1d99-e59a-4ad0-a613-1674a247d17c tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd5fc6167654972868941ed28c327b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6241924efa944a68503a87b695c7410', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:51:58.478300 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-20ad1d99-e59a-4ad0-a613-1674a247d17c tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/762e880e-7ec3-41bb-aac7-fa05de4efd11" status: 200 len: 1312 microversion: 2.1 time: 0.288679 Jun 23 11:51:58.478894 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 410/851] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:51:58 2022] GET /compute/v2.1/servers/762e880e-7ec3-41bb-aac7-fa05de4efd11 => generated 1312 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:51:58.847522 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [req-e693cc84-127f-483d-86c6-07eeaf9b074f req-a7065413-7135-42dd-9d00-f5b627848639 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e51258d-c99d-4d15-8463-c699bcfa9143", "tag": "2fc09618-5ffd-4c12-8072-c756814d925d"}]} {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:51:58.856138 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-e693cc84-127f-483d-86c6-07eeaf9b074f req-a7065413-7135-42dd-9d00-f5b627848639 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:58.856585 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-e693cc84-127f-483d-86c6-07eeaf9b074f req-a7065413-7135-42dd-9d00-f5b627848639 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:58.870106 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.compute.server_external_events [req-e693cc84-127f-483d-86c6-07eeaf9b074f req-a7065413-7135-42dd-9d00-f5b627848639 service nova] Creating event network-changed:2fc09618-5ffd-4c12-8072-c756814d925d for instance 1e51258d-c99d-4d15-8463-c699bcfa9143 on hv-cinder-82099 Jun 23 11:51:58.875593 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [req-e693cc84-127f-483d-86c6-07eeaf9b074f req-a7065413-7135-42dd-9d00-f5b627848639 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032329 Jun 23 11:51:58.876191 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 442/852] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:51:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:51:59.290146 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-5b7953a6-7a8f-4be9-bc90-25a8632dd51b tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:51:59.290793 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-5b7953a6-7a8f-4be9-bc90-25a8632dd51b tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:51:59.298246 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-5b7953a6-7a8f-4be9-bc90-25a8632dd51b tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:59.298829 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-5b7953a6-7a8f-4be9-bc90-25a8632dd51b tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:59.299672 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-5b7953a6-7a8f-4be9-bc90-25a8632dd51b tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:59.300178 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-5b7953a6-7a8f-4be9-bc90-25a8632dd51b tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:59.468866 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-5b7953a6-7a8f-4be9-bc90-25a8632dd51b tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:51:59.477005 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-5b7953a6-7a8f-4be9-bc90-25a8632dd51b tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 200 len: 1676 microversion: 2.1 time: 0.190926 Jun 23 11:51:59.477966 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 411/853] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:51:59 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 1676 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:51:59.480186 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-e21ecc90-5f00-4d06-9ef0-714d71939938 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:51:59.480930 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-e21ecc90-5f00-4d06-9ef0-714d71939938 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:51:59.495544 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-e21ecc90-5f00-4d06-9ef0-714d71939938 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:59.495989 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-e21ecc90-5f00-4d06-9ef0-714d71939938 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:59.496743 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-e21ecc90-5f00-4d06-9ef0-714d71939938 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:59.497077 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-8334a16b-5027-41e4-b902-89bf8f485704 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:51:59.497218 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-e21ecc90-5f00-4d06-9ef0-714d71939938 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:59.497700 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-8334a16b-5027-41e4-b902-89bf8f485704 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] [instance: 762e880e-7ec3-41bb-aac7-fa05de4efd11] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:51:59.504411 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-8334a16b-5027-41e4-b902-89bf8f485704 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:59.505165 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-8334a16b-5027-41e4-b902-89bf8f485704 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:59.506176 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-8334a16b-5027-41e4-b902-89bf8f485704 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:51:59.506874 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-8334a16b-5027-41e4-b902-89bf8f485704 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:51:59.521462 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.wsgi [None req-8334a16b-5027-41e4-b902-89bf8f485704 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] HTTP exception thrown: Instance 762e880e-7ec3-41bb-aac7-fa05de4efd11 could not be found. Jun 23 11:51:59.523756 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-8334a16b-5027-41e4-b902-89bf8f485704 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Request method failure captured: Jun 23 11:51:59.523756 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: request: GET /compute/v2.1/servers/762e880e-7ec3-41bb-aac7-fa05de4efd11 HTTP/1.1 Jun 23 11:51:59.523756 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Accept: application/json Jun 23 11:51:59.523756 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Accept-Encoding: identity Jun 23 11:51:59.523756 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Connection: close Jun 23 11:51:59.523756 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Content-Length: 0 Jun 23 11:51:59.523756 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Content-Type: application/json Jun 23 11:51:59.523756 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Host: 10.222.0.13 Jun 23 11:51:59.523756 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Openstack-System-Scope: None Jun 23 11:51:59.523756 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: User-Agent: python-urllib3/1.26.9 Jun 23 11:51:59.523756 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Auth-Token: gAAAAABitFIQMZzIonjUbfDwf8XrsOwiJZRU6mFcRB1-tnfeb_v3NOEweS__m4o1J8UHtu-_xrjURmrJ6fzG89APjTfsnyiQVFAZpTd13GqegTFfQ58YDG0ZJ0-BfSv3ftKHTlhdH_kG2HiseMXvNGBpCdtSjep9DwmxqUcu34-5A9JBS3aKDXY Jun 23 11:51:59.523756 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Domain-Id: None Jun 23 11:51:59.523756 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Domain-Name: None Jun 23 11:51:59.523756 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Identity-Status: Confirmed Jun 23 11:51:59.523756 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Is-Admin-Project: True Jun 23 11:51:59.523756 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Domain-Id: default Jun 23 11:51:59.523756 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Domain-Name: Default Jun 23 11:51:59.523756 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Id: b6241924efa944a68503a87b695c7410 Jun 23 11:51:59.523756 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-493570352 Jun 23 11:51:59.523756 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Role: member,reader Jun 23 11:51:59.523756 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Roles: member,reader Jun 23 11:51:59.525074 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b6241924efa944a68503a87b695c7410"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b6241924efa944a68503a87b695c7410"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b6241924efa944a68503a87b695c7410"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b6241924efa944a68503a87b695c7410"}]}] Jun 23 11:51:59.525074 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant: tempest-ServerRescueNegativeTestJSON-493570352 Jun 23 11:51:59.525074 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant-Id: b6241924efa944a68503a87b695c7410 Jun 23 11:51:59.525074 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-493570352 Jun 23 11:51:59.525074 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User: tempest-ServerRescueNegativeTestJSON-493570352-project Jun 23 11:51:59.525074 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Domain-Id: default Jun 23 11:51:59.525074 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Domain-Name: Default Jun 23 11:51:59.525074 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Id: bcd5fc6167654972868941ed28c327b6 Jun 23 11:51:59.525074 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Name: tempest-ServerRescueNegativeTestJSON-493570352-project Jun 23 11:51:59.525074 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: method: > Jun 23 11:51:59.525074 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: exception: Instance 762e880e-7ec3-41bb-aac7-fa05de4efd11 could not be found. Jun 23 11:51:59.525074 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: action_args: {'id': '762e880e-7ec3-41bb-aac7-fa05de4efd11'} Jun 23 11:51:59.525803 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:51:59.525803 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:51:59.525803 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:51:59.525803 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:51:59.525803 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:51:59.525803 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:51:59.525803 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:51:59.525803 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:51:59.525803 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:51:59.525803 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:51:59.525803 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 762e880e-7ec3-41bb-aac7-fa05de4efd11 could not be found. Jun 23 11:51:59.525803 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:51:59.525803 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:51:59.525803 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:51:59.525803 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:51:59.525803 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:51:59.525803 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:51:59.525803 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:51:59.525803 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:51:59.525803 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:51:59.527019 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:51:59.527019 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 11:51:59.527019 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 11:51:59.527019 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:51:59.527019 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:51:59.527019 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:51:59.527019 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:51:59.527019 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 762e880e-7ec3-41bb-aac7-fa05de4efd11 could not be found. Jun 23 11:51:59.527019 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:51:59.527019 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:51:59.527019 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:51:59.527019 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:51:59.527019 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:51:59.527019 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:51:59.527019 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:51:59.527019 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:51:59.527019 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 762e880e-7ec3-41bb-aac7-fa05de4efd11 could not be found. Jun 23 11:51:59.527019 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:51:59.529431 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-8334a16b-5027-41e4-b902-89bf8f485704 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] Returning 404 to user: Instance 762e880e-7ec3-41bb-aac7-fa05de4efd11 could not be found. {{(pid=124669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:51:59.531091 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-8334a16b-5027-41e4-b902-89bf8f485704 tempest-ServerRescueNegativeTestJSON-493570352 tempest-ServerRescueNegativeTestJSON-493570352-project] 10.222.0.13 "GET /compute/v2.1/servers/762e880e-7ec3-41bb-aac7-fa05de4efd11" status: 404 len: 111 microversion: 2.1 time: 0.038072 Jun 23 11:51:59.531867 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 412/854] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:51:59 2022] GET /compute/v2.1/servers/762e880e-7ec3-41bb-aac7-fa05de4efd11 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:51:59.719850 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-e21ecc90-5f00-4d06-9ef0-714d71939938 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:51:59.729976 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-e21ecc90-5f00-4d06-9ef0-714d71939938 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:51:59.732238 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-e21ecc90-5f00-4d06-9ef0-714d71939938 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:51:59.734082 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-e21ecc90-5f00-4d06-9ef0-714d71939938 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143" status: 200 len: 1407 microversion: 2.20 time: 0.257643 Jun 23 11:51:59.735214 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 443/855] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:51:59 2022] GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 => generated 1407 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:52:00.495930 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-de72a57a-1bc8-4cde-a8c9-6bbdf8e0e5c4 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:52:00.496547 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-de72a57a-1bc8-4cde-a8c9-6bbdf8e0e5c4 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:52:00.504229 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-de72a57a-1bc8-4cde-a8c9-6bbdf8e0e5c4 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:52:00.504682 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-de72a57a-1bc8-4cde-a8c9-6bbdf8e0e5c4 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:52:00.505453 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-de72a57a-1bc8-4cde-a8c9-6bbdf8e0e5c4 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:52:00.505878 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-de72a57a-1bc8-4cde-a8c9-6bbdf8e0e5c4 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:52:00.570562 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-de72a57a-1bc8-4cde-a8c9-6bbdf8e0e5c4 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:52:00.578497 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-de72a57a-1bc8-4cde-a8c9-6bbdf8e0e5c4 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 200 len: 1608 microversion: 2.1 time: 0.086509 Jun 23 11:52:00.579061 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 413/856] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:52:00 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 1608 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:52:00.752325 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-a17fa5a8-7455-456e-8055-a86c839ff513 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:52:00.752936 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-a17fa5a8-7455-456e-8055-a86c839ff513 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:52:00.759515 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a17fa5a8-7455-456e-8055-a86c839ff513 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:52:00.759960 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a17fa5a8-7455-456e-8055-a86c839ff513 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:52:00.760752 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a17fa5a8-7455-456e-8055-a86c839ff513 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:52:00.761184 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a17fa5a8-7455-456e-8055-a86c839ff513 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:52:00.888717 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-a17fa5a8-7455-456e-8055-a86c839ff513 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:52:00.897472 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-a17fa5a8-7455-456e-8055-a86c839ff513 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:52:00.899011 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-a17fa5a8-7455-456e-8055-a86c839ff513 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:52:00.900135 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-a17fa5a8-7455-456e-8055-a86c839ff513 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143" status: 200 len: 1407 microversion: 2.20 time: 0.152409 Jun 23 11:52:00.900834 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 444/857] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:52:00 2022] GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:52:01.100382 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [req-aa720aa6-5061-4aa6-9ad3-7f4e597694ab req-2144f6d5-f54d-4526-8560-7fbd385c785d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46d9d467-7a71-4e30-af82-629121319200", "name": "network-vif-deleted", "tag": "0a894540-735d-4ac5-8343-16862b680cd3"}]} {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:52:01.110713 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [req-aa720aa6-5061-4aa6-9ad3-7f4e597694ab req-2144f6d5-f54d-4526-8560-7fbd385c785d service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:52:01.111423 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [req-aa720aa6-5061-4aa6-9ad3-7f4e597694ab req-2144f6d5-f54d-4526-8560-7fbd385c785d service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:52:01.127774 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.compute.server_external_events [req-aa720aa6-5061-4aa6-9ad3-7f4e597694ab req-2144f6d5-f54d-4526-8560-7fbd385c785d service nova] Creating event network-vif-deleted:0a894540-735d-4ac5-8343-16862b680cd3 for instance 46d9d467-7a71-4e30-af82-629121319200 on hv-cinder-82099 Jun 23 11:52:01.132989 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [req-aa720aa6-5061-4aa6-9ad3-7f4e597694ab req-2144f6d5-f54d-4526-8560-7fbd385c785d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037070 Jun 23 11:52:01.133990 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 414/858] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:52:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:52:01.596170 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-e4937ea3-5a68-4097-9b55-fe375355c81a tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:52:01.596802 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-e4937ea3-5a68-4097-9b55-fe375355c81a tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:52:01.603204 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-e4937ea3-5a68-4097-9b55-fe375355c81a tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:52:01.603784 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-e4937ea3-5a68-4097-9b55-fe375355c81a tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:52:01.617731 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-e4937ea3-5a68-4097-9b55-fe375355c81a tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:52:01.620464 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-e4937ea3-5a68-4097-9b55-fe375355c81a tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:52:01.689059 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-e4937ea3-5a68-4097-9b55-fe375355c81a tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:52:01.697343 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-e4937ea3-5a68-4097-9b55-fe375355c81a tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 200 len: 1608 microversion: 2.1 time: 0.105747 Jun 23 11:52:01.698091 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 445/859] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:52:01 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 1608 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:52:01.922426 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-fc28b6e0-de80-43ca-b980-9ddd4b4adea5 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:52:01.923759 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-fc28b6e0-de80-43ca-b980-9ddd4b4adea5 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:52:01.930951 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-fc28b6e0-de80-43ca-b980-9ddd4b4adea5 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:52:01.931704 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-fc28b6e0-de80-43ca-b980-9ddd4b4adea5 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:52:01.932957 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-fc28b6e0-de80-43ca-b980-9ddd4b4adea5 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:52:01.933590 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-fc28b6e0-de80-43ca-b980-9ddd4b4adea5 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:52:02.083264 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-fc28b6e0-de80-43ca-b980-9ddd4b4adea5 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:52:02.094291 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-fc28b6e0-de80-43ca-b980-9ddd4b4adea5 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:52:02.095937 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-fc28b6e0-de80-43ca-b980-9ddd4b4adea5 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:52:02.097049 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-fc28b6e0-de80-43ca-b980-9ddd4b4adea5 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143" status: 200 len: 1407 microversion: 2.20 time: 0.181003 Jun 23 11:52:02.097858 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 415/860] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:52:01 2022] GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 => generated 1407 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:52:02.715645 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-5be6773a-f83d-474f-ac74-5c82d60558da tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:52:02.716258 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-5be6773a-f83d-474f-ac74-5c82d60558da tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:52:02.723222 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-5be6773a-f83d-474f-ac74-5c82d60558da tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:52:02.723674 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-5be6773a-f83d-474f-ac74-5c82d60558da tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:52:02.724505 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-5be6773a-f83d-474f-ac74-5c82d60558da tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:52:02.724877 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-5be6773a-f83d-474f-ac74-5c82d60558da tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:52:02.760292 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-5be6773a-f83d-474f-ac74-5c82d60558da tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:52:02.760804 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-5be6773a-f83d-474f-ac74-5c82d60558da tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:52:02.761278 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.objects.instance [None req-5be6773a-f83d-474f-ac74-5c82d60558da tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lazy-loading 'fault' on Instance uuid 46d9d467-7a71-4e30-af82-629121319200 {{(pid=124670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:52:02.802285 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-5be6773a-f83d-474f-ac74-5c82d60558da tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:52:02.809886 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-5be6773a-f83d-474f-ac74-5c82d60558da tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 200 len: 1328 microversion: 2.1 time: 0.098145 Jun 23 11:52:02.810587 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 446/861] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:52:02 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 1328 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:52:03.119474 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-1d2cc42f-f228-4246-9e27-da627b2daacc tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:52:03.120670 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-1d2cc42f-f228-4246-9e27-da627b2daacc tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:52:03.132250 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-1d2cc42f-f228-4246-9e27-da627b2daacc tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:52:03.132753 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-1d2cc42f-f228-4246-9e27-da627b2daacc tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:52:03.133528 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-1d2cc42f-f228-4246-9e27-da627b2daacc tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:52:03.133969 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-1d2cc42f-f228-4246-9e27-da627b2daacc tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:52:03.437822 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-1d2cc42f-f228-4246-9e27-da627b2daacc tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:52:03.447361 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-1d2cc42f-f228-4246-9e27-da627b2daacc tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:52:03.448867 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-1d2cc42f-f228-4246-9e27-da627b2daacc tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:52:03.450035 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-1d2cc42f-f228-4246-9e27-da627b2daacc tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143" status: 200 len: 1407 microversion: 2.20 time: 0.336217 Jun 23 11:52:03.460959 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 416/862] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:52:03 2022] GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 => generated 1407 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:52:03.830471 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-fca0a49e-3933-4778-8943-b9a32ad14dde tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:52:03.831711 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-fca0a49e-3933-4778-8943-b9a32ad14dde tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:52:03.838849 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-fca0a49e-3933-4778-8943-b9a32ad14dde tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:52:03.839312 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-fca0a49e-3933-4778-8943-b9a32ad14dde tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:52:03.840089 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-fca0a49e-3933-4778-8943-b9a32ad14dde tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:52:03.840524 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-fca0a49e-3933-4778-8943-b9a32ad14dde tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:52:03.855570 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.wsgi [None req-fca0a49e-3933-4778-8943-b9a32ad14dde tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] HTTP exception thrown: Instance 46d9d467-7a71-4e30-af82-629121319200 could not be found. Jun 23 11:52:03.857259 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-fca0a49e-3933-4778-8943-b9a32ad14dde tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Request method failure captured: Jun 23 11:52:03.857259 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: request: GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 HTTP/1.1 Jun 23 11:52:03.857259 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Accept: application/json Jun 23 11:52:03.857259 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Accept-Encoding: identity Jun 23 11:52:03.857259 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Connection: close Jun 23 11:52:03.857259 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Content-Length: 0 Jun 23 11:52:03.857259 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Content-Type: application/json Jun 23 11:52:03.857259 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Host: 10.222.0.13 Jun 23 11:52:03.857259 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Openstack-System-Scope: None Jun 23 11:52:03.857259 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: User-Agent: python-urllib3/1.26.9 Jun 23 11:52:03.857259 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Auth-Token: gAAAAABitFIUQzOKuurMnNUOBvgY4yrpwEpnJMiMRzCK2tzH0MUYk3j0socpW3oTND0Y-B0317GKEWcjAzAVg9cfaIVQTXrjnZagc0UeMsJBhfIMA6yFi6o2shaxocTT76xdSS-L5NqwUWnNEvP-ma1e0DcCmcptGshQYH5SdpjbuMIl853SdqE Jun 23 11:52:03.857259 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Domain-Id: None Jun 23 11:52:03.857259 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Domain-Name: None Jun 23 11:52:03.857259 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Identity-Status: Confirmed Jun 23 11:52:03.857259 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Is-Admin-Project: True Jun 23 11:52:03.857259 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Domain-Id: default Jun 23 11:52:03.857259 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Domain-Name: Default Jun 23 11:52:03.857259 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Id: 45db495ff8c04b55b44c80a3ab412fb9 Jun 23 11:52:03.857259 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Name: tempest-AttachVolumeTestJSON-552659924 Jun 23 11:52:03.857259 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Role: member,reader Jun 23 11:52:03.857259 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Roles: member,reader Jun 23 11:52:03.858934 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_45db495ff8c04b55b44c80a3ab412fb9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/45db495ff8c04b55b44c80a3ab412fb9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/45db495ff8c04b55b44c80a3ab412fb9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/45db495ff8c04b55b44c80a3ab412fb9"}]}] Jun 23 11:52:03.858934 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Tenant: tempest-AttachVolumeTestJSON-552659924 Jun 23 11:52:03.858934 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Tenant-Id: 45db495ff8c04b55b44c80a3ab412fb9 Jun 23 11:52:03.858934 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Tenant-Name: tempest-AttachVolumeTestJSON-552659924 Jun 23 11:52:03.858934 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User: tempest-AttachVolumeTestJSON-552659924-project Jun 23 11:52:03.858934 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Domain-Id: default Jun 23 11:52:03.858934 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Domain-Name: Default Jun 23 11:52:03.858934 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Id: d1b988f3241a46308b7c3683e2943b78 Jun 23 11:52:03.858934 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Name: tempest-AttachVolumeTestJSON-552659924-project Jun 23 11:52:03.858934 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: method: > Jun 23 11:52:03.858934 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: exception: Instance 46d9d467-7a71-4e30-af82-629121319200 could not be found. Jun 23 11:52:03.858934 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: action_args: {'id': '46d9d467-7a71-4e30-af82-629121319200'} Jun 23 11:52:03.859785 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:52:03.859785 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:52:03.859785 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:52:03.859785 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:52:03.859785 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:52:03.859785 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:52:03.859785 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:52:03.859785 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:52:03.859785 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:52:03.859785 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:52:03.859785 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46d9d467-7a71-4e30-af82-629121319200 could not be found. Jun 23 11:52:03.859785 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:52:03.859785 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:52:03.859785 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:52:03.859785 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:52:03.859785 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:52:03.859785 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:52:03.859785 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:52:03.859785 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:52:03.859785 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:52:03.861049 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:52:03.861049 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 11:52:03.861049 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 11:52:03.861049 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:52:03.861049 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:52:03.861049 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:52:03.861049 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:52:03.861049 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46d9d467-7a71-4e30-af82-629121319200 could not be found. Jun 23 11:52:03.861049 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:52:03.861049 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:52:03.861049 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:52:03.861049 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:52:03.861049 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:52:03.861049 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:52:03.861049 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:52:03.861049 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:52:03.861049 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46d9d467-7a71-4e30-af82-629121319200 could not be found. Jun 23 11:52:03.861049 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:52:03.862135 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-fca0a49e-3933-4778-8943-b9a32ad14dde tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Returning 404 to user: Instance 46d9d467-7a71-4e30-af82-629121319200 could not be found. {{(pid=124670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:52:03.862135 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-fca0a49e-3933-4778-8943-b9a32ad14dde tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 404 len: 111 microversion: 2.1 time: 0.035150 Jun 23 11:52:03.862135 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 447/863] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:52:03 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:52:03.867981 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-f2d75fc0-504f-4b73-91bb-fd9b02a86e1e tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '.version_select at 0x7f5d071bdd30>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:52:04.003108 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-f2d75fc0-504f-4b73-91bb-fd9b02a86e1e tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1124038880" status: 202 len: 0 microversion: 2.1 time: 0.138603 Jun 23 11:52:04.003675 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 417/864] 10.222.0.13 () {58 vars in 1220 bytes} [Thu Jun 23 11:52:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1124038880 => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 11:52:04.469689 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-598cfaf2-cdc9-445c-ac7d-5c888d18d83e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:52:04.470615 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-598cfaf2-cdc9-445c-ac7d-5c888d18d83e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:52:04.477285 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-598cfaf2-cdc9-445c-ac7d-5c888d18d83e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:52:04.478057 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-598cfaf2-cdc9-445c-ac7d-5c888d18d83e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:52:04.479088 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-598cfaf2-cdc9-445c-ac7d-5c888d18d83e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:52:04.479765 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-598cfaf2-cdc9-445c-ac7d-5c888d18d83e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:52:04.648279 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-598cfaf2-cdc9-445c-ac7d-5c888d18d83e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:52:04.657063 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-598cfaf2-cdc9-445c-ac7d-5c888d18d83e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:52:04.658594 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-598cfaf2-cdc9-445c-ac7d-5c888d18d83e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:52:04.659711 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-598cfaf2-cdc9-445c-ac7d-5c888d18d83e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143" status: 200 len: 1407 microversion: 2.20 time: 0.194762 Jun 23 11:52:04.660277 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 448/865] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:52:04 2022] GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 => generated 1407 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:52:04.915378 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_cell0:SELECT=2 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:52:04.915964 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_cell0:SELECT=6 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:52:04.919848 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-8bde4f1d-aabd-4f1e-95e3-da82612cce9b tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Action: 'create', calling method: .version_select at 0x7f5d0654aaf0>, body: {"keypair": {"name": "tempest-keypair-552322715", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCiZ+4YVW3CigmctliqbRGMPzccVUFhImJVZupgc9P2TAHtVJhO+SewoHQxfR7vv3+PqgKLzCX8n5tMVibESMpNcTyoAIz3b1xc8w5aEpYzUz3Cyr088CnpfMWXBUbAttw=="}} {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:52:04.934341 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.quota [None req-8bde4f1d-aabd-4f1e-95e3-da82612cce9b tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Getting quotas for project 45db495ff8c04b55b44c80a3ab412fb9. Resources: {'key_pairs'} {{(pid=124669) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:52:04.936796 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=3,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:52:04.938898 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.quota [None req-8bde4f1d-aabd-4f1e-95e3-da82612cce9b tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Getting quotas for user d1b988f3241a46308b7c3683e2943b78 and project 45db495ff8c04b55b44c80a3ab412fb9. Resources: {'key_pairs'} {{(pid=124669) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:52:05.060431 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-8bde4f1d-aabd-4f1e-95e3-da82612cce9b tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.146368 Jun 23 11:52:05.061027 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 418/866] 10.222.0.13 () {60 vars in 1158 bytes} [Thu Jun 23 11:52:04 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:52:05.678055 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-b383a31e-e606-4cfa-9bb3-df4dda866396 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:52:05.678785 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-b383a31e-e606-4cfa-9bb3-df4dda866396 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:52:05.680855 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_cell0:SELECT=6 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:52:05.687811 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-b383a31e-e606-4cfa-9bb3-df4dda866396 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:52:05.688379 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-b383a31e-e606-4cfa-9bb3-df4dda866396 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:52:05.693777 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-b383a31e-e606-4cfa-9bb3-df4dda866396 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:52:05.693777 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-b383a31e-e606-4cfa-9bb3-df4dda866396 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:52:05.830359 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-b383a31e-e606-4cfa-9bb3-df4dda866396 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:52:05.838553 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-b383a31e-e606-4cfa-9bb3-df4dda866396 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:52:05.840102 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-b383a31e-e606-4cfa-9bb3-df4dda866396 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:52:05.841231 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-b383a31e-e606-4cfa-9bb3-df4dda866396 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143" status: 200 len: 1407 microversion: 2.20 time: 0.167554 Jun 23 11:52:05.844920 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 449/867] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:52:05 2022] GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:52:06.678330 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [req-6cc6db9e-d709-4b09-8a9b-627e3df1b20f req-92a62406-1a65-4acf-a920-4e1ddc1a1746 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e51258d-c99d-4d15-8463-c699bcfa9143", "name": "network-vif-plugged", "status": "completed", "tag": "2fc09618-5ffd-4c12-8072-c756814d925d"}]} {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:52:06.689282 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [req-6cc6db9e-d709-4b09-8a9b-627e3df1b20f req-92a62406-1a65-4acf-a920-4e1ddc1a1746 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:52:06.689728 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [req-6cc6db9e-d709-4b09-8a9b-627e3df1b20f req-92a62406-1a65-4acf-a920-4e1ddc1a1746 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:52:06.704451 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.compute.server_external_events [req-6cc6db9e-d709-4b09-8a9b-627e3df1b20f req-92a62406-1a65-4acf-a920-4e1ddc1a1746 service nova] Creating event network-vif-plugged:2fc09618-5ffd-4c12-8072-c756814d925d for instance 1e51258d-c99d-4d15-8463-c699bcfa9143 on hv-cinder-82099 Jun 23 11:52:06.709482 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [req-6cc6db9e-d709-4b09-8a9b-627e3df1b20f req-92a62406-1a65-4acf-a920-4e1ddc1a1746 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034784 Jun 23 11:52:06.710269 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 419/868] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:52:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:52:06.860337 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-ef0ac450-9323-422a-9cbe-36b9909171ce tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:52:06.860949 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-ef0ac450-9323-422a-9cbe-36b9909171ce tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:52:06.867804 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-ef0ac450-9323-422a-9cbe-36b9909171ce tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:52:06.868445 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-ef0ac450-9323-422a-9cbe-36b9909171ce tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:52:06.869202 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-ef0ac450-9323-422a-9cbe-36b9909171ce tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:52:06.869635 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-ef0ac450-9323-422a-9cbe-36b9909171ce tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:52:07.024582 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-ef0ac450-9323-422a-9cbe-36b9909171ce tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:52:07.032713 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-ef0ac450-9323-422a-9cbe-36b9909171ce tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:52:07.034212 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-ef0ac450-9323-422a-9cbe-36b9909171ce tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:52:07.035351 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-ef0ac450-9323-422a-9cbe-36b9909171ce tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143" status: 200 len: 1407 microversion: 2.20 time: 0.179445 Jun 23 11:52:07.046225 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 450/869] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:52:06 2022] GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 => generated 1407 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:52:07.730040 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-77745077-a6ff-4463-bd36-d6b52038805a tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1804097679", "imageRef": "b19d6f23-214c-4432-bee6-455978023759", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6028cdda-cfa0-48e7-849f-0656110a3a2b"}], "security_groups": [{"name": "tempest-securitygroup--1015439768"}], "key_name": "tempest-keypair-552322715", "user_data": "}} {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:52:07.837245 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.network.neutron [None req-77745077-a6ff-4463-bd36-d6b52038805a tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] validate_networks() for [('6028cdda-cfa0-48e7-849f-0656110a3a2b', None, None, None, None, None)] {{(pid=124669) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 11:52:08.052643 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-a1df6085-b2a2-49f7-8585-edd9d3ba239c tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:52:08.053495 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-a1df6085-b2a2-49f7-8585-edd9d3ba239c tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:52:08.060114 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a1df6085-b2a2-49f7-8585-edd9d3ba239c tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:52:08.062244 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a1df6085-b2a2-49f7-8585-edd9d3ba239c tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:52:08.062244 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a1df6085-b2a2-49f7-8585-edd9d3ba239c tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:52:08.062244 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a1df6085-b2a2-49f7-8585-edd9d3ba239c tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:52:08.271436 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-a1df6085-b2a2-49f7-8585-edd9d3ba239c tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:52:08.280969 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-a1df6085-b2a2-49f7-8585-edd9d3ba239c tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:52:08.282482 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-a1df6085-b2a2-49f7-8585-edd9d3ba239c tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:52:08.283622 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-a1df6085-b2a2-49f7-8585-edd9d3ba239c tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143" status: 200 len: 1407 microversion: 2.20 time: 0.234932 Jun 23 11:52:08.285756 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 451/870] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:52:08 2022] GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 => generated 1407 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:52:08.293965 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.virt.hardware [None req-77745077-a6ff-4463-bd36-d6b52038805a tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Flavor limits 0:0:0 {{(pid=124669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 11:52:08.294385 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.virt.hardware [None req-77745077-a6ff-4463-bd36-d6b52038805a tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Image limits 0:0:0 {{(pid=124669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 11:52:08.294889 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.virt.hardware [None req-77745077-a6ff-4463-bd36-d6b52038805a tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Flavor pref 0:0:0 {{(pid=124669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 11:52:08.295317 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.virt.hardware [None req-77745077-a6ff-4463-bd36-d6b52038805a tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Image pref 0:0:0 {{(pid=124669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 11:52:08.296330 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.virt.hardware [None req-77745077-a6ff-4463-bd36-d6b52038805a tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 11:52:08.305498 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-77745077-a6ff-4463-bd36-d6b52038805a tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:52:08.310465 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-77745077-a6ff-4463-bd36-d6b52038805a tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:52:08.310465 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-77745077-a6ff-4463-bd36-d6b52038805a tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:52:08.310465 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-77745077-a6ff-4463-bd36-d6b52038805a tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:52:08.324341 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.quota [None req-77745077-a6ff-4463-bd36-d6b52038805a tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Getting quotas for project 45db495ff8c04b55b44c80a3ab412fb9. Resources: {'cores', 'instances', 'ram'} {{(pid=124669) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:52:08.328411 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.quota [None req-77745077-a6ff-4463-bd36-d6b52038805a tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Getting quotas for user d1b988f3241a46308b7c3683e2943b78 and project 45db495ff8c04b55b44c80a3ab412fb9. Resources: {'cores', 'instances', 'ram'} {{(pid=124669) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:52:08.339224 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-77745077-a6ff-4463-bd36-d6b52038805a tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Going to run 1 instances... {{(pid=124669) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 11:52:08.341505 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-77745077-a6ff-4463-bd36-d6b52038805a tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: f0c76b74-bb63-4f9a-aede-52182140750b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b19d6f23-214c-4432-bee6-455978023759',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124669) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 11:52:08.560095 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-77745077-a6ff-4463-bd36-d6b52038805a tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.835207 Jun 23 11:52:08.561077 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 420/871] 10.222.0.13 () {60 vars in 1146 bytes} [Thu Jun 23 11:52:07 2022] POST /compute/v2.1/servers => generated 402 bytes in 837 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 11:52:08.571440 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-bab65901-7d32-4dc5-af64-42c825b127e0 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:52:08.572043 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-bab65901-7d32-4dc5-af64-42c825b127e0 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: f0c76b74-bb63-4f9a-aede-52182140750b] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:52:08.630867 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-bab65901-7d32-4dc5-af64-42c825b127e0 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:52:08.638490 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-bab65901-7d32-4dc5-af64-42c825b127e0 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/f0c76b74-bb63-4f9a-aede-52182140750b" status: 200 len: 1237 microversion: 2.1 time: 0.071116 Jun 23 11:52:08.639996 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 452/872] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:52:08 2022] GET /compute/v2.1/servers/f0c76b74-bb63-4f9a-aede-52182140750b => generated 1237 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:52:09.302668 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-1765da41-5b28-4e9a-ad41-44dcbb6242e0 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:52:09.303807 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-1765da41-5b28-4e9a-ad41-44dcbb6242e0 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:52:09.310834 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-1765da41-5b28-4e9a-ad41-44dcbb6242e0 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:52:09.311226 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-1765da41-5b28-4e9a-ad41-44dcbb6242e0 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:52:09.312596 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-1765da41-5b28-4e9a-ad41-44dcbb6242e0 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:52:09.313041 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-1765da41-5b28-4e9a-ad41-44dcbb6242e0 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:52:09.443490 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-1765da41-5b28-4e9a-ad41-44dcbb6242e0 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:52:09.451542 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-1765da41-5b28-4e9a-ad41-44dcbb6242e0 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:52:09.453128 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-1765da41-5b28-4e9a-ad41-44dcbb6242e0 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:52:09.454287 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-1765da41-5b28-4e9a-ad41-44dcbb6242e0 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143" status: 200 len: 1600 microversion: 2.20 time: 0.156050 Jun 23 11:52:09.454867 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 421/873] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:52:09 2022] GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:52:09.477456 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-5e6bea1e-b709-4394-9862-6dca7de7e7d8 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:52:09.478084 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-5e6bea1e-b709-4394-9862-6dca7de7e7d8 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:52:09.485568 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-5e6bea1e-b709-4394-9862-6dca7de7e7d8 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:52:09.486245 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-5e6bea1e-b709-4394-9862-6dca7de7e7d8 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:52:09.487128 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-5e6bea1e-b709-4394-9862-6dca7de7e7d8 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:52:09.487854 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-5e6bea1e-b709-4394-9862-6dca7de7e7d8 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:52:09.506248 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:52:09.574887 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-5e6bea1e-b709-4394-9862-6dca7de7e7d8 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.101193 Jun 23 11:52:09.575573 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 453/874] 10.222.0.13 () {60 vars in 1315 bytes} [Thu Jun 23 11:52:09 2022] GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143/os-interface => generated 285 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 11:52:09.657294 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-9e50ee57-12e2-4ec9-b43f-f22ea08a1f05 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:52:09.657998 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-9e50ee57-12e2-4ec9-b43f-f22ea08a1f05 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: f0c76b74-bb63-4f9a-aede-52182140750b] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:52:09.664172 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-9e50ee57-12e2-4ec9-b43f-f22ea08a1f05 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:52:09.665231 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-9e50ee57-12e2-4ec9-b43f-f22ea08a1f05 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:52:09.665445 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-9e50ee57-12e2-4ec9-b43f-f22ea08a1f05 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:52:09.666055 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-9e50ee57-12e2-4ec9-b43f-f22ea08a1f05 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:52:09.752916 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-9e50ee57-12e2-4ec9-b43f-f22ea08a1f05 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:52:09.757443 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:52:09.762033 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-9e50ee57-12e2-4ec9-b43f-f22ea08a1f05 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/f0c76b74-bb63-4f9a-aede-52182140750b" status: 200 len: 1241 microversion: 2.1 time: 0.109567 Jun 23 11:52:09.762676 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 422/875] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:52:09 2022] GET /compute/v2.1/servers/f0c76b74-bb63-4f9a-aede-52182140750b => generated 1241 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:52:10.779590 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-3d684021-672d-4cc8-96c2-daa68aa1f561 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:52:10.781723 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-3d684021-672d-4cc8-96c2-daa68aa1f561 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: f0c76b74-bb63-4f9a-aede-52182140750b] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:52:10.792467 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-3d684021-672d-4cc8-96c2-daa68aa1f561 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:52:10.792923 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-3d684021-672d-4cc8-96c2-daa68aa1f561 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:52:10.793880 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-3d684021-672d-4cc8-96c2-daa68aa1f561 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:52:10.794318 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-3d684021-672d-4cc8-96c2-daa68aa1f561 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:52:10.931911 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-3d684021-672d-4cc8-96c2-daa68aa1f561 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:52:10.942329 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-3d684021-672d-4cc8-96c2-daa68aa1f561 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/f0c76b74-bb63-4f9a-aede-52182140750b" status: 200 len: 1297 microversion: 2.1 time: 0.167261 Jun 23 11:52:10.946751 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 454/876] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:52:10 2022] GET /compute/v2.1/servers/f0c76b74-bb63-4f9a-aede-52182140750b => generated 1297 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:52:10.991082 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [req-be3495e1-e5c8-4fdc-92ba-ea2b11cd9732 req-081797b9-644b-4040-9d3d-cca0f8a5cd42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e51258d-c99d-4d15-8463-c699bcfa9143", "tag": "2fc09618-5ffd-4c12-8072-c756814d925d"}]} {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:52:11.008710 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [req-be3495e1-e5c8-4fdc-92ba-ea2b11cd9732 req-081797b9-644b-4040-9d3d-cca0f8a5cd42 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:52:11.013095 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [req-be3495e1-e5c8-4fdc-92ba-ea2b11cd9732 req-081797b9-644b-4040-9d3d-cca0f8a5cd42 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:52:11.023765 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.compute.server_external_events [req-be3495e1-e5c8-4fdc-92ba-ea2b11cd9732 req-081797b9-644b-4040-9d3d-cca0f8a5cd42 service nova] Creating event network-changed:2fc09618-5ffd-4c12-8072-c756814d925d for instance 1e51258d-c99d-4d15-8463-c699bcfa9143 on hv-cinder-82099 Jun 23 11:52:11.029087 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [req-be3495e1-e5c8-4fdc-92ba-ea2b11cd9732 req-081797b9-644b-4040-9d3d-cca0f8a5cd42 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042842 Jun 23 11:52:11.030763 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 423/877] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:52:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:52:11.965374 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-7c425818-be9a-4868-ae0a-eccb8d4b32a1 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:52:11.969141 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-7c425818-be9a-4868-ae0a-eccb8d4b32a1 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: f0c76b74-bb63-4f9a-aede-52182140750b] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:52:11.978729 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-7c425818-be9a-4868-ae0a-eccb8d4b32a1 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:52:11.979437 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-7c425818-be9a-4868-ae0a-eccb8d4b32a1 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:52:11.980621 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-7c425818-be9a-4868-ae0a-eccb8d4b32a1 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:52:11.981056 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-7c425818-be9a-4868-ae0a-eccb8d4b32a1 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:52:12.138152 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-7c425818-be9a-4868-ae0a-eccb8d4b32a1 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:52:12.147837 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-7c425818-be9a-4868-ae0a-eccb8d4b32a1 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/f0c76b74-bb63-4f9a-aede-52182140750b" status: 200 len: 1363 microversion: 2.1 time: 0.188341 Jun 23 11:52:12.148841 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 455/878] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:52:11 2022] GET /compute/v2.1/servers/f0c76b74-bb63-4f9a-aede-52182140750b => generated 1363 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:52:12.513446 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [req-e37e3efa-a145-4c15-90b7-02484cf72302 req-6e59953d-15c3-4973-8a7f-b778f29bfcbb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0c76b74-bb63-4f9a-aede-52182140750b", "tag": "f26edc32-0ff6-4bcf-9cbf-72ae91e04852"}]} {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:52:12.526867 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [req-e37e3efa-a145-4c15-90b7-02484cf72302 req-6e59953d-15c3-4973-8a7f-b778f29bfcbb service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:52:12.527581 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [req-e37e3efa-a145-4c15-90b7-02484cf72302 req-6e59953d-15c3-4973-8a7f-b778f29bfcbb service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:52:12.555299 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.compute.server_external_events [req-e37e3efa-a145-4c15-90b7-02484cf72302 req-6e59953d-15c3-4973-8a7f-b778f29bfcbb service nova] Creating event network-changed:f26edc32-0ff6-4bcf-9cbf-72ae91e04852 for instance f0c76b74-bb63-4f9a-aede-52182140750b on hv-cinder-82099 Jun 23 11:52:12.560337 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [req-e37e3efa-a145-4c15-90b7-02484cf72302 req-6e59953d-15c3-4973-8a7f-b778f29bfcbb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052229 Jun 23 11:52:12.561462 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 424/879] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:52:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:52:13.165436 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-b9af5f2c-9a72-4b13-8ca8-8f1aab9de7c6 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:52:13.166071 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-b9af5f2c-9a72-4b13-8ca8-8f1aab9de7c6 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: f0c76b74-bb63-4f9a-aede-52182140750b] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:52:13.173315 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-b9af5f2c-9a72-4b13-8ca8-8f1aab9de7c6 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:52:13.173939 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-b9af5f2c-9a72-4b13-8ca8-8f1aab9de7c6 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:52:13.174742 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-b9af5f2c-9a72-4b13-8ca8-8f1aab9de7c6 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:52:13.175183 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-b9af5f2c-9a72-4b13-8ca8-8f1aab9de7c6 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:52:13.327863 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-b9af5f2c-9a72-4b13-8ca8-8f1aab9de7c6 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:52:13.335439 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-b9af5f2c-9a72-4b13-8ca8-8f1aab9de7c6 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/f0c76b74-bb63-4f9a-aede-52182140750b" status: 200 len: 1363 microversion: 2.1 time: 0.174169 Jun 23 11:52:13.336012 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 456/880] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:52:13 2022] GET /compute/v2.1/servers/f0c76b74-bb63-4f9a-aede-52182140750b => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:52:14.353618 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-829fc1dc-b7ad-4d04-8de2-37634860688f tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:52:14.354310 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-829fc1dc-b7ad-4d04-8de2-37634860688f tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: f0c76b74-bb63-4f9a-aede-52182140750b] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:52:14.361499 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-829fc1dc-b7ad-4d04-8de2-37634860688f tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:52:14.361940 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-829fc1dc-b7ad-4d04-8de2-37634860688f tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:52:14.362719 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-829fc1dc-b7ad-4d04-8de2-37634860688f tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:52:14.363147 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-829fc1dc-b7ad-4d04-8de2-37634860688f tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:52:14.489722 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-829fc1dc-b7ad-4d04-8de2-37634860688f tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:52:14.497281 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-829fc1dc-b7ad-4d04-8de2-37634860688f tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/f0c76b74-bb63-4f9a-aede-52182140750b" status: 200 len: 1363 microversion: 2.1 time: 0.147784 Jun 23 11:52:14.497849 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 425/881] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:52:14 2022] GET /compute/v2.1/servers/f0c76b74-bb63-4f9a-aede-52182140750b => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:52:15.514586 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-23c9d036-fbf0-4868-8c92-3d8b0fcd850f tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:52:15.515351 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-23c9d036-fbf0-4868-8c92-3d8b0fcd850f tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: f0c76b74-bb63-4f9a-aede-52182140750b] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:52:15.518119 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=1,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:52:15.523346 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-23c9d036-fbf0-4868-8c92-3d8b0fcd850f tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:52:15.523797 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-23c9d036-fbf0-4868-8c92-3d8b0fcd850f tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:52:15.524550 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-23c9d036-fbf0-4868-8c92-3d8b0fcd850f tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:52:15.524976 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-23c9d036-fbf0-4868-8c92-3d8b0fcd850f tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:52:15.661658 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-23c9d036-fbf0-4868-8c92-3d8b0fcd850f tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:52:15.669044 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-23c9d036-fbf0-4868-8c92-3d8b0fcd850f tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/f0c76b74-bb63-4f9a-aede-52182140750b" status: 200 len: 1363 microversion: 2.1 time: 0.158266 Jun 23 11:52:15.669600 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 457/882] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:52:15 2022] GET /compute/v2.1/servers/f0c76b74-bb63-4f9a-aede-52182140750b => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:52:16.685311 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-2bdeb89c-6395-4c9a-afe4-fdccf1a2b7fc tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:52:16.685916 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-2bdeb89c-6395-4c9a-afe4-fdccf1a2b7fc tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: f0c76b74-bb63-4f9a-aede-52182140750b] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:52:16.692783 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-2bdeb89c-6395-4c9a-afe4-fdccf1a2b7fc tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:52:16.696509 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-2bdeb89c-6395-4c9a-afe4-fdccf1a2b7fc tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:52:16.696509 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-2bdeb89c-6395-4c9a-afe4-fdccf1a2b7fc tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:52:16.696509 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-2bdeb89c-6395-4c9a-afe4-fdccf1a2b7fc tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:52:16.823934 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-2bdeb89c-6395-4c9a-afe4-fdccf1a2b7fc tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:52:16.831977 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-2bdeb89c-6395-4c9a-afe4-fdccf1a2b7fc tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/f0c76b74-bb63-4f9a-aede-52182140750b" status: 200 len: 1363 microversion: 2.1 time: 0.150627 Jun 23 11:52:16.832530 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 426/883] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:52:16 2022] GET /compute/v2.1/servers/f0c76b74-bb63-4f9a-aede-52182140750b => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:52:17.849852 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-8c23932a-ea17-444f-b6b0-c4b4ffd146de tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:52:17.850457 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-8c23932a-ea17-444f-b6b0-c4b4ffd146de tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: f0c76b74-bb63-4f9a-aede-52182140750b] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:52:17.859920 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-8c23932a-ea17-444f-b6b0-c4b4ffd146de tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:52:17.860368 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-8c23932a-ea17-444f-b6b0-c4b4ffd146de tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:52:17.861154 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-8c23932a-ea17-444f-b6b0-c4b4ffd146de tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:52:17.861874 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-8c23932a-ea17-444f-b6b0-c4b4ffd146de tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:52:17.990382 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-8c23932a-ea17-444f-b6b0-c4b4ffd146de tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:52:17.997702 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-8c23932a-ea17-444f-b6b0-c4b4ffd146de tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/f0c76b74-bb63-4f9a-aede-52182140750b" status: 200 len: 1363 microversion: 2.1 time: 0.152900 Jun 23 11:52:17.998271 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 458/884] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:52:17 2022] GET /compute/v2.1/servers/f0c76b74-bb63-4f9a-aede-52182140750b => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:52:19.014948 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-68bd68b6-157f-4d46-8907-25e2908f21e6 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:52:19.015562 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-68bd68b6-157f-4d46-8907-25e2908f21e6 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: f0c76b74-bb63-4f9a-aede-52182140750b] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:52:19.018024 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_cell0:SELECT=2 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:52:19.018707 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_cell0:SELECT=10 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:52:19.023621 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-68bd68b6-157f-4d46-8907-25e2908f21e6 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:52:19.024078 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-68bd68b6-157f-4d46-8907-25e2908f21e6 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:52:19.024847 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-68bd68b6-157f-4d46-8907-25e2908f21e6 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:52:19.025285 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-68bd68b6-157f-4d46-8907-25e2908f21e6 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:52:19.158428 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-68bd68b6-157f-4d46-8907-25e2908f21e6 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:52:19.165997 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-68bd68b6-157f-4d46-8907-25e2908f21e6 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/f0c76b74-bb63-4f9a-aede-52182140750b" status: 200 len: 1363 microversion: 2.1 time: 0.154938 Jun 23 11:52:19.166576 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 427/885] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:52:19 2022] GET /compute/v2.1/servers/f0c76b74-bb63-4f9a-aede-52182140750b => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:52:20.183255 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-12c15a38-e451-4fa1-a821-56ced5da1548 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:52:20.183787 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-12c15a38-e451-4fa1-a821-56ced5da1548 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: f0c76b74-bb63-4f9a-aede-52182140750b] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:52:20.185609 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_cell0:SELECT=2 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:52:20.190726 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-12c15a38-e451-4fa1-a821-56ced5da1548 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:52:20.191210 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-12c15a38-e451-4fa1-a821-56ced5da1548 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:52:20.192001 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-12c15a38-e451-4fa1-a821-56ced5da1548 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:52:20.192434 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-12c15a38-e451-4fa1-a821-56ced5da1548 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:52:20.325573 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-12c15a38-e451-4fa1-a821-56ced5da1548 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:52:20.333033 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-12c15a38-e451-4fa1-a821-56ced5da1548 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/f0c76b74-bb63-4f9a-aede-52182140750b" status: 200 len: 1363 microversion: 2.1 time: 0.153781 Jun 23 11:52:20.333597 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 459/886] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:52:20 2022] GET /compute/v2.1/servers/f0c76b74-bb63-4f9a-aede-52182140750b => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:52:21.350337 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-64bea12b-6901-4a99-b938-cb83ad7c4de2 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:52:21.350925 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-64bea12b-6901-4a99-b938-cb83ad7c4de2 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: f0c76b74-bb63-4f9a-aede-52182140750b] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:52:21.357081 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-64bea12b-6901-4a99-b938-cb83ad7c4de2 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:52:21.357532 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-64bea12b-6901-4a99-b938-cb83ad7c4de2 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:52:21.358385 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-64bea12b-6901-4a99-b938-cb83ad7c4de2 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:52:21.358848 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-64bea12b-6901-4a99-b938-cb83ad7c4de2 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:52:21.502809 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-64bea12b-6901-4a99-b938-cb83ad7c4de2 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:52:21.507078 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-64bea12b-6901-4a99-b938-cb83ad7c4de2 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/f0c76b74-bb63-4f9a-aede-52182140750b" status: 200 len: 1363 microversion: 2.1 time: 0.161159 Jun 23 11:52:21.507769 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 428/887] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:52:21 2022] GET /compute/v2.1/servers/f0c76b74-bb63-4f9a-aede-52182140750b => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:52:22.040992 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [req-b9fc47b1-9a00-4c4f-aaf6-85fccf55871e req-e01b7fc2-0c20-4439-8d2d-df3216bdf74e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0c76b74-bb63-4f9a-aede-52182140750b", "name": "network-vif-plugged", "status": "completed", "tag": "f26edc32-0ff6-4bcf-9cbf-72ae91e04852"}]} {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:52:22.048974 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-b9fc47b1-9a00-4c4f-aaf6-85fccf55871e req-e01b7fc2-0c20-4439-8d2d-df3216bdf74e service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:52:22.049437 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-b9fc47b1-9a00-4c4f-aaf6-85fccf55871e req-e01b7fc2-0c20-4439-8d2d-df3216bdf74e service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:52:22.060232 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.compute.server_external_events [req-b9fc47b1-9a00-4c4f-aaf6-85fccf55871e req-e01b7fc2-0c20-4439-8d2d-df3216bdf74e service nova] Creating event network-vif-plugged:f26edc32-0ff6-4bcf-9cbf-72ae91e04852 for instance f0c76b74-bb63-4f9a-aede-52182140750b on hv-cinder-82099 Jun 23 11:52:22.065353 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [req-b9fc47b1-9a00-4c4f-aaf6-85fccf55871e req-e01b7fc2-0c20-4439-8d2d-df3216bdf74e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028011 Jun 23 11:52:22.069615 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 460/888] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:52:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:52:22.524949 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-2c6a326a-8130-4f14-a660-59c653eaefd8 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:52:22.525617 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-2c6a326a-8130-4f14-a660-59c653eaefd8 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: f0c76b74-bb63-4f9a-aede-52182140750b] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:52:22.532184 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-2c6a326a-8130-4f14-a660-59c653eaefd8 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:52:22.532655 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-2c6a326a-8130-4f14-a660-59c653eaefd8 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:52:22.533406 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-2c6a326a-8130-4f14-a660-59c653eaefd8 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:52:22.534407 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-2c6a326a-8130-4f14-a660-59c653eaefd8 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:52:22.666329 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-2c6a326a-8130-4f14-a660-59c653eaefd8 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:52:22.676029 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-2c6a326a-8130-4f14-a660-59c653eaefd8 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/f0c76b74-bb63-4f9a-aede-52182140750b" status: 200 len: 1363 microversion: 2.1 time: 0.153025 Jun 23 11:52:22.676029 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 429/889] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:52:22 2022] GET /compute/v2.1/servers/f0c76b74-bb63-4f9a-aede-52182140750b => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:52:23.692196 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-e3a89967-8461-4a86-9e26-b36be22330be tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:52:23.693052 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-e3a89967-8461-4a86-9e26-b36be22330be tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: f0c76b74-bb63-4f9a-aede-52182140750b] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:52:23.699316 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-e3a89967-8461-4a86-9e26-b36be22330be tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:52:23.699763 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-e3a89967-8461-4a86-9e26-b36be22330be tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:52:23.700514 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-e3a89967-8461-4a86-9e26-b36be22330be tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:52:23.700946 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-e3a89967-8461-4a86-9e26-b36be22330be tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:52:23.834115 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-e3a89967-8461-4a86-9e26-b36be22330be tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:52:23.841495 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-e3a89967-8461-4a86-9e26-b36be22330be tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/f0c76b74-bb63-4f9a-aede-52182140750b" status: 200 len: 1363 microversion: 2.1 time: 0.153540 Jun 23 11:52:23.842097 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 461/890] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:52:23 2022] GET /compute/v2.1/servers/f0c76b74-bb63-4f9a-aede-52182140750b => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:52:24.858123 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-53881474-3870-4808-87ce-25338339b54f tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:52:24.858954 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-53881474-3870-4808-87ce-25338339b54f tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: f0c76b74-bb63-4f9a-aede-52182140750b] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:52:24.865688 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-53881474-3870-4808-87ce-25338339b54f tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:52:24.866141 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-53881474-3870-4808-87ce-25338339b54f tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:52:24.866935 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-53881474-3870-4808-87ce-25338339b54f tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:52:24.867382 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-53881474-3870-4808-87ce-25338339b54f tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:52:25.024199 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-53881474-3870-4808-87ce-25338339b54f tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:52:25.031604 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-53881474-3870-4808-87ce-25338339b54f tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/f0c76b74-bb63-4f9a-aede-52182140750b" status: 200 len: 1549 microversion: 2.1 time: 0.177448 Jun 23 11:52:25.034323 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 430/891] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:52:24 2022] GET /compute/v2.1/servers/f0c76b74-bb63-4f9a-aede-52182140750b => generated 1549 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:52:25.048907 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-613ef45a-a626-4320-ac32-4e0dc35bdeca tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:52:25.049514 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-613ef45a-a626-4320-ac32-4e0dc35bdeca tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: f0c76b74-bb63-4f9a-aede-52182140750b] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:52:25.055724 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-613ef45a-a626-4320-ac32-4e0dc35bdeca tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:52:25.056176 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-613ef45a-a626-4320-ac32-4e0dc35bdeca tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:52:25.056936 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-613ef45a-a626-4320-ac32-4e0dc35bdeca tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:52:25.057377 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-613ef45a-a626-4320-ac32-4e0dc35bdeca tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:52:25.151111 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-613ef45a-a626-4320-ac32-4e0dc35bdeca tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/f0c76b74-bb63-4f9a-aede-52182140750b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.105958 Jun 23 11:52:25.151701 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 462/892] 10.222.0.13 () {58 vars in 1274 bytes} [Thu Jun 23 11:52:25 2022] GET /compute/v2.1/servers/f0c76b74-bb63-4f9a-aede-52182140750b/os-interface => generated 284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:52:26.195497 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [req-f3c21261-4970-4d61-96c8-761afe8aeefc req-258d556d-0229-418d-9c2c-9e1631560e62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0c76b74-bb63-4f9a-aede-52182140750b", "tag": "f26edc32-0ff6-4bcf-9cbf-72ae91e04852"}]} {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:52:26.205562 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [req-f3c21261-4970-4d61-96c8-761afe8aeefc req-258d556d-0229-418d-9c2c-9e1631560e62 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:52:26.206497 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [req-f3c21261-4970-4d61-96c8-761afe8aeefc req-258d556d-0229-418d-9c2c-9e1631560e62 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:52:26.217357 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.compute.server_external_events [req-f3c21261-4970-4d61-96c8-761afe8aeefc req-258d556d-0229-418d-9c2c-9e1631560e62 service nova] Creating event network-changed:f26edc32-0ff6-4bcf-9cbf-72ae91e04852 for instance f0c76b74-bb63-4f9a-aede-52182140750b on hv-cinder-82099 Jun 23 11:52:26.223117 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [req-f3c21261-4970-4d61-96c8-761afe8aeefc req-258d556d-0229-418d-9c2c-9e1631560e62 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031379 Jun 23 11:52:26.224114 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 431/893] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:52:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:52:35.603501 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_api:SELECT=11 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:52:35.604837 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_cell1:SELECT=49 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:52:35.608827 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-4ab64355-c3fc-4ecc-94ed-f4611b96470d tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:52:35.609318 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-4ab64355-c3fc-4ecc-94ed-f4611b96470d tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] [instance: c026366c-311a-45eb-899c-30703cd7eb1d] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:52:35.609709 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [req-6ae392a4-b8d3-4815-a964-91d6c8336b83 req-9f8c870d-4701-4158-9d49-152c373cacee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c026366c-311a-45eb-899c-30703cd7eb1d", "tag": "0d774b3d-b1c7-415f-9da5-0abe6a54a4eb"}]} {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:52:35.616180 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-4ab64355-c3fc-4ecc-94ed-f4611b96470d tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:52:35.620296 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [req-6ae392a4-b8d3-4815-a964-91d6c8336b83 req-9f8c870d-4701-4158-9d49-152c373cacee service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:52:35.620737 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [req-6ae392a4-b8d3-4815-a964-91d6c8336b83 req-9f8c870d-4701-4158-9d49-152c373cacee service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:52:35.622302 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-4ab64355-c3fc-4ecc-94ed-f4611b96470d tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:52:35.623276 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-4ab64355-c3fc-4ecc-94ed-f4611b96470d tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:52:35.623710 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-4ab64355-c3fc-4ecc-94ed-f4611b96470d tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:52:35.641015 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.compute.server_external_events [req-6ae392a4-b8d3-4815-a964-91d6c8336b83 req-9f8c870d-4701-4158-9d49-152c373cacee service nova] Creating event network-changed:0d774b3d-b1c7-415f-9da5-0abe6a54a4eb for instance c026366c-311a-45eb-899c-30703cd7eb1d on hv-cinder-82099 Jun 23 11:52:35.648327 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [req-6ae392a4-b8d3-4815-a964-91d6c8336b83 req-9f8c870d-4701-4158-9d49-152c373cacee service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042925 Jun 23 11:52:35.650857 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 432/894] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:52:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:52:35.656420 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-4ab64355-c3fc-4ecc-94ed-f4611b96470d tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] [instance: c026366c-311a-45eb-899c-30703cd7eb1d] Going to try to terminate instance {{(pid=124670) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 11:52:36.049719 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-4ab64355-c3fc-4ecc-94ed-f4611b96470d tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] 10.222.0.13 "DELETE /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d" status: 204 len: 0 microversion: 2.1 time: 0.447105 Jun 23 11:52:36.050676 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 463/895] 10.222.0.13 () {58 vars in 1238 bytes} [Thu Jun 23 11:52:35 2022] DELETE /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d => generated 0 bytes in 449 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 11:52:36.059653 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-ed77e1e1-986f-486d-b6f7-f688c021410c tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:52:36.060530 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-ed77e1e1-986f-486d-b6f7-f688c021410c tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] [instance: c026366c-311a-45eb-899c-30703cd7eb1d] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:52:36.073067 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ed77e1e1-986f-486d-b6f7-f688c021410c tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:52:36.073694 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ed77e1e1-986f-486d-b6f7-f688c021410c tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:52:36.076610 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ed77e1e1-986f-486d-b6f7-f688c021410c tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:52:36.077174 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ed77e1e1-986f-486d-b6f7-f688c021410c tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:52:36.244993 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-ed77e1e1-986f-486d-b6f7-f688c021410c tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626c3dbdc0f1407db82d6988e68e40b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce01d9a78d3f4bb7b101b47548b73037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:52:36.254595 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-ed77e1e1-986f-486d-b6f7-f688c021410c tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] 10.222.0.13 "GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d" status: 200 len: 1568 microversion: 2.1 time: 0.199256 Jun 23 11:52:36.255563 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 433/896] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:52:36 2022] GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d => generated 1568 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:52:37.272996 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-8298bec1-eb7b-4731-a2c1-937472450506 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:52:37.273711 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-8298bec1-eb7b-4731-a2c1-937472450506 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] [instance: c026366c-311a-45eb-899c-30703cd7eb1d] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:52:37.279666 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-8298bec1-eb7b-4731-a2c1-937472450506 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:52:37.280115 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-8298bec1-eb7b-4731-a2c1-937472450506 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:52:37.280877 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-8298bec1-eb7b-4731-a2c1-937472450506 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:52:37.281305 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-8298bec1-eb7b-4731-a2c1-937472450506 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:52:37.439118 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-8298bec1-eb7b-4731-a2c1-937472450506 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626c3dbdc0f1407db82d6988e68e40b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce01d9a78d3f4bb7b101b47548b73037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:52:37.448259 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-8298bec1-eb7b-4731-a2c1-937472450506 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] 10.222.0.13 "GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d" status: 200 len: 1568 microversion: 2.1 time: 0.179647 Jun 23 11:52:37.448833 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 464/897] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:52:37 2022] GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d => generated 1568 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:52:38.468360 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-b96c99ea-3164-45b6-ae19-d5168b722f76 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:52:38.468360 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-b96c99ea-3164-45b6-ae19-d5168b722f76 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] [instance: c026366c-311a-45eb-899c-30703cd7eb1d] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:52:38.473270 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=4 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:52:38.476454 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-b96c99ea-3164-45b6-ae19-d5168b722f76 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:52:38.476815 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-b96c99ea-3164-45b6-ae19-d5168b722f76 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:52:38.477586 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-b96c99ea-3164-45b6-ae19-d5168b722f76 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:52:38.478181 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-b96c99ea-3164-45b6-ae19-d5168b722f76 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:52:38.508825 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [req-be9c5353-a8e1-4147-b320-a5e81305b026 req-86b5b0df-bf8d-4909-8bda-49d7885df489 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c026366c-311a-45eb-899c-30703cd7eb1d", "name": "network-vif-deleted", "tag": "0d774b3d-b1c7-415f-9da5-0abe6a54a4eb"}]} {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:52:38.518108 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-be9c5353-a8e1-4147-b320-a5e81305b026 req-86b5b0df-bf8d-4909-8bda-49d7885df489 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:52:38.518108 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-be9c5353-a8e1-4147-b320-a5e81305b026 req-86b5b0df-bf8d-4909-8bda-49d7885df489 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:52:38.529033 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.compute.server_external_events [req-be9c5353-a8e1-4147-b320-a5e81305b026 req-86b5b0df-bf8d-4909-8bda-49d7885df489 service nova] Creating event network-vif-deleted:0d774b3d-b1c7-415f-9da5-0abe6a54a4eb for instance c026366c-311a-45eb-899c-30703cd7eb1d on hv-cinder-82099 Jun 23 11:52:38.533725 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [req-be9c5353-a8e1-4147-b320-a5e81305b026 req-86b5b0df-bf8d-4909-8bda-49d7885df489 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028519 Jun 23 11:52:38.535759 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 465/898] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:52:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:52:38.544169 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-b96c99ea-3164-45b6-ae19-d5168b722f76 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626c3dbdc0f1407db82d6988e68e40b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce01d9a78d3f4bb7b101b47548b73037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:52:38.552434 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-b96c99ea-3164-45b6-ae19-d5168b722f76 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] 10.222.0.13 "GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d" status: 200 len: 1381 microversion: 2.1 time: 0.089501 Jun 23 11:52:38.553031 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 434/899] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:52:38 2022] GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d => generated 1381 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:52:39.569850 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-955bb0de-66da-467b-8bd6-67fb352da854 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:52:39.570595 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-955bb0de-66da-467b-8bd6-67fb352da854 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] [instance: c026366c-311a-45eb-899c-30703cd7eb1d] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:52:39.576805 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-955bb0de-66da-467b-8bd6-67fb352da854 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:52:39.577256 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-955bb0de-66da-467b-8bd6-67fb352da854 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:52:39.578089 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-955bb0de-66da-467b-8bd6-67fb352da854 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:52:39.578547 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-955bb0de-66da-467b-8bd6-67fb352da854 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:52:39.610582 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-955bb0de-66da-467b-8bd6-67fb352da854 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:52:39.611032 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-955bb0de-66da-467b-8bd6-67fb352da854 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:52:39.611483 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.objects.instance [None req-955bb0de-66da-467b-8bd6-67fb352da854 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lazy-loading 'fault' on Instance uuid c026366c-311a-45eb-899c-30703cd7eb1d {{(pid=124670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:52:39.656605 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-955bb0de-66da-467b-8bd6-67fb352da854 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '626c3dbdc0f1407db82d6988e68e40b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce01d9a78d3f4bb7b101b47548b73037', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:52:39.666786 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-955bb0de-66da-467b-8bd6-67fb352da854 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] 10.222.0.13 "GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d" status: 200 len: 1224 microversion: 2.1 time: 0.101258 Jun 23 11:52:39.667590 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 466/900] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:52:39 2022] GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d => generated 1224 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:52:40.686376 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-97bbe846-5a44-45ad-ac1d-d1a556e03316 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:52:40.687042 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-97bbe846-5a44-45ad-ac1d-d1a556e03316 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] [instance: c026366c-311a-45eb-899c-30703cd7eb1d] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:52:40.694231 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-97bbe846-5a44-45ad-ac1d-d1a556e03316 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:52:40.694724 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-97bbe846-5a44-45ad-ac1d-d1a556e03316 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:52:40.695499 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-97bbe846-5a44-45ad-ac1d-d1a556e03316 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:52:40.695945 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-97bbe846-5a44-45ad-ac1d-d1a556e03316 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:52:40.711983 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.wsgi [None req-97bbe846-5a44-45ad-ac1d-d1a556e03316 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] HTTP exception thrown: Instance c026366c-311a-45eb-899c-30703cd7eb1d could not be found. Jun 23 11:52:40.713765 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-97bbe846-5a44-45ad-ac1d-d1a556e03316 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Request method failure captured: Jun 23 11:52:40.713765 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: request: GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d HTTP/1.1 Jun 23 11:52:40.713765 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Accept: application/json Jun 23 11:52:40.713765 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Accept-Encoding: identity Jun 23 11:52:40.713765 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Connection: close Jun 23 11:52:40.713765 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Content-Length: 0 Jun 23 11:52:40.713765 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Content-Type: application/json Jun 23 11:52:40.713765 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Host: 10.222.0.13 Jun 23 11:52:40.713765 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Openstack-System-Scope: None Jun 23 11:52:40.713765 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: User-Agent: python-urllib3/1.26.9 Jun 23 11:52:40.713765 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Auth-Token: gAAAAABitFJxONolWAPiPBqSD_vlzwEBkymcmqhUS1PRre9enItzBYpmbx_gsigTHV6d9V6d57oG-yowtzpHXn9InE7jniLnQ-bicF78Cc49nBjY_gwME7Jv6Fk8ph12Rr9KqNTHGy49ls8XlPBHMp0ucfEKm0yNsnSULcLNWxaEX4fmpIqWwrs Jun 23 11:52:40.713765 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Domain-Id: None Jun 23 11:52:40.713765 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Domain-Name: None Jun 23 11:52:40.713765 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Identity-Status: Confirmed Jun 23 11:52:40.713765 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Is-Admin-Project: True Jun 23 11:52:40.713765 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Domain-Id: default Jun 23 11:52:40.713765 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Domain-Name: Default Jun 23 11:52:40.713765 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Id: ce01d9a78d3f4bb7b101b47548b73037 Jun 23 11:52:40.713765 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Name: tempest-TestShelveInstance-1784490872 Jun 23 11:52:40.713765 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Role: member,reader Jun 23 11:52:40.713765 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Roles: member,reader Jun 23 11:52:40.717694 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ce01d9a78d3f4bb7b101b47548b73037"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ce01d9a78d3f4bb7b101b47548b73037"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ce01d9a78d3f4bb7b101b47548b73037"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ce01d9a78d3f4bb7b101b47548b73037"}]}] Jun 23 11:52:40.717694 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant: tempest-TestShelveInstance-1784490872 Jun 23 11:52:40.717694 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant-Id: ce01d9a78d3f4bb7b101b47548b73037 Jun 23 11:52:40.717694 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant-Name: tempest-TestShelveInstance-1784490872 Jun 23 11:52:40.717694 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User: tempest-TestShelveInstance-1784490872-project Jun 23 11:52:40.717694 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Domain-Id: default Jun 23 11:52:40.717694 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Domain-Name: Default Jun 23 11:52:40.717694 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Id: 626c3dbdc0f1407db82d6988e68e40b2 Jun 23 11:52:40.717694 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Name: tempest-TestShelveInstance-1784490872-project Jun 23 11:52:40.717694 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: method: > Jun 23 11:52:40.717694 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: exception: Instance c026366c-311a-45eb-899c-30703cd7eb1d could not be found. Jun 23 11:52:40.717694 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: action_args: {'id': 'c026366c-311a-45eb-899c-30703cd7eb1d'} Jun 23 11:52:40.718644 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:52:40.718644 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:52:40.718644 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:52:40.718644 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:52:40.718644 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:52:40.718644 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:52:40.718644 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:52:40.718644 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:52:40.718644 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:52:40.718644 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:52:40.718644 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c026366c-311a-45eb-899c-30703cd7eb1d could not be found. Jun 23 11:52:40.718644 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:52:40.718644 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:52:40.718644 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:52:40.718644 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:52:40.718644 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:52:40.718644 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:52:40.718644 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:52:40.718644 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:52:40.718644 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:52:40.720187 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:52:40.720187 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 11:52:40.720187 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 11:52:40.720187 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:52:40.720187 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:52:40.720187 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:52:40.720187 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:52:40.720187 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c026366c-311a-45eb-899c-30703cd7eb1d could not be found. Jun 23 11:52:40.720187 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:52:40.720187 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:52:40.720187 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:52:40.720187 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:52:40.720187 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:52:40.720187 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:52:40.720187 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:52:40.720187 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:52:40.720187 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c026366c-311a-45eb-899c-30703cd7eb1d could not be found. Jun 23 11:52:40.720187 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:52:40.722681 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-97bbe846-5a44-45ad-ac1d-d1a556e03316 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Returning 404 to user: Instance c026366c-311a-45eb-899c-30703cd7eb1d could not be found. {{(pid=124669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:52:40.722681 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-97bbe846-5a44-45ad-ac1d-d1a556e03316 tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] 10.222.0.13 "GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d" status: 404 len: 111 microversion: 2.1 time: 0.032836 Jun 23 11:52:40.722681 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 435/901] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:52:40 2022] GET /compute/v2.1/servers/c026366c-311a-45eb-899c-30703cd7eb1d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:52:40.949072 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-a1f960a4-1536-4ec2-9e34-b2d487c9917b tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] Calling method '.version_select at 0x7f5d0681b040>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:52:41.031191 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-a1f960a4-1536-4ec2-9e34-b2d487c9917b tempest-TestShelveInstance-1784490872 tempest-TestShelveInstance-1784490872-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-464325998" status: 202 len: 0 microversion: 2.1 time: 0.085944 Jun 23 11:52:41.031900 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 467/902] 10.222.0.13 () {58 vars in 1250 bytes} [Thu Jun 23 11:52:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-464325998 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 11:52:50.438812 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-5d9ae7c0-a472-4dc6-9250-28a9db9ea6a1 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:52:50.439356 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-5d9ae7c0-a472-4dc6-9250-28a9db9ea6a1 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 284456f6-2347-46c7-bec1-2acb170b7421] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:52:50.446208 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-5d9ae7c0-a472-4dc6-9250-28a9db9ea6a1 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:52:50.446780 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-5d9ae7c0-a472-4dc6-9250-28a9db9ea6a1 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:52:50.447544 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-5d9ae7c0-a472-4dc6-9250-28a9db9ea6a1 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:52:50.447980 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-5d9ae7c0-a472-4dc6-9250-28a9db9ea6a1 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:52:50.451587 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_cell1:SELECT=59 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:52:50.473036 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-5d9ae7c0-a472-4dc6-9250-28a9db9ea6a1 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/284456f6-2347-46c7-bec1-2acb170b7421/ips" status: 200 len: 150 microversion: 2.1 time: 0.036980 Jun 23 11:52:50.473627 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 436/903] 10.222.0.13 () {58 vars in 1247 bytes} [Thu Jun 23 11:52:50 2022] GET /compute/v2.1/servers/284456f6-2347-46c7-bec1-2acb170b7421/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:52:52.199153 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:52:52.199901 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:52:52.203930 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-6bb22e36-d3e5-4b16-9624-1fec6940a908 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "426087e4-bd05-4a10-86ad-dd9059820ce0"}} {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:52:52.205009 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-6bb22e36-d3e5-4b16-9624-1fec6940a908 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 284456f6-2347-46c7-bec1-2acb170b7421] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:52:52.211219 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-6bb22e36-d3e5-4b16-9624-1fec6940a908 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:52:52.211662 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-6bb22e36-d3e5-4b16-9624-1fec6940a908 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:52:52.212412 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-6bb22e36-d3e5-4b16-9624-1fec6940a908 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:52:52.212882 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-6bb22e36-d3e5-4b16-9624-1fec6940a908 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:52:52.990118 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-6bb22e36-d3e5-4b16-9624-1fec6940a908 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "POST /compute/v2.1/servers/284456f6-2347-46c7-bec1-2acb170b7421/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.791634 Jun 23 11:52:52.990771 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 468/904] 10.222.0.13 () {60 vars in 1322 bytes} [Thu Jun 23 11:52:52 2022] POST /compute/v2.1/servers/284456f6-2347-46c7-bec1-2acb170b7421/os-volume_attachments => generated 194 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:53:01.549908 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-e7eb9a6d-adf8-4ace-af9c-b3ca46185850 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "426087e4-bd05-4a10-86ad-dd9059820ce0"}} {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:53:01.551052 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-e7eb9a6d-adf8-4ace-af9c-b3ca46185850 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 284456f6-2347-46c7-bec1-2acb170b7421] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:53:01.553758 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_api:SELECT=5 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:53:01.558394 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-e7eb9a6d-adf8-4ace-af9c-b3ca46185850 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:53:01.558870 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-e7eb9a6d-adf8-4ace-af9c-b3ca46185850 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:53:01.563842 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-e7eb9a6d-adf8-4ace-af9c-b3ca46185850 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:53:01.563842 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-e7eb9a6d-adf8-4ace-af9c-b3ca46185850 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:53:01.639669 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.wsgi [None req-e7eb9a6d-adf8-4ace-af9c-b3ca46185850 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] HTTP exception thrown: Invalid volume: volume 426087e4-bd05-4a10-86ad-dd9059820ce0 is already attached to instances: 284456f6-2347-46c7-bec1-2acb170b7421 Jun 23 11:53:01.641314 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-e7eb9a6d-adf8-4ace-af9c-b3ca46185850 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Request method failure captured: Jun 23 11:53:01.641314 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: request: POST /compute/v2.1/servers/284456f6-2347-46c7-bec1-2acb170b7421/os-volume_attachments HTTP/1.1 Jun 23 11:53:01.641314 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Accept: application/json Jun 23 11:53:01.641314 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Accept-Encoding: identity Jun 23 11:53:01.641314 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Connection: close Jun 23 11:53:01.641314 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Content-Length: 74 Jun 23 11:53:01.641314 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Content-Type: application/json Jun 23 11:53:01.641314 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Host: 10.222.0.13 Jun 23 11:53:01.641314 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Openstack-System-Scope: None Jun 23 11:53:01.641314 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: User-Agent: python-urllib3/1.26.9 Jun 23 11:53:01.641314 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Auth-Token: gAAAAABitFIKMke7vIBbvXT2RfPc-4frmGbwTZtMddIa6SPtgPblRzRqc8HMry6yk8WPdy-omEmS4IGKEBZ0krkMZ2AKKZ3XIi6QwXYCvuOyoif5_u-lfFNTFOpNeH9m810_qoSsO3823Vbqo3_NJM0PRtSxfQcTjP265INpx0gWYDOG-d8IrtY Jun 23 11:53:01.641314 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Domain-Id: None Jun 23 11:53:01.641314 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Domain-Name: None Jun 23 11:53:01.641314 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Identity-Status: Confirmed Jun 23 11:53:01.641314 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Is-Admin-Project: True Jun 23 11:53:01.641314 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Domain-Id: default Jun 23 11:53:01.641314 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Domain-Name: Default Jun 23 11:53:01.641314 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Id: ee135767dfc846469d64b658372994a8 Jun 23 11:53:01.641314 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Name: tempest-AttachVolumeNegativeTest-213077295 Jun 23 11:53:01.641314 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Role: member,reader Jun 23 11:53:01.641314 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Roles: member,reader Jun 23 11:53:01.643081 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ee135767dfc846469d64b658372994a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ee135767dfc846469d64b658372994a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ee135767dfc846469d64b658372994a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ee135767dfc846469d64b658372994a8"}]}] Jun 23 11:53:01.643081 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant: tempest-AttachVolumeNegativeTest-213077295 Jun 23 11:53:01.643081 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant-Id: ee135767dfc846469d64b658372994a8 Jun 23 11:53:01.643081 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-213077295 Jun 23 11:53:01.643081 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User: tempest-AttachVolumeNegativeTest-213077295-project Jun 23 11:53:01.643081 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Domain-Id: default Jun 23 11:53:01.643081 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Domain-Name: Default Jun 23 11:53:01.643081 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Id: b7fd8323d29d445f903e2103453e8ae6 Jun 23 11:53:01.643081 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Name: tempest-AttachVolumeNegativeTest-213077295-project Jun 23 11:53:01.643081 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Jun 23 11:53:01.643081 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: {"volumeAttachment": {"volumeId": "426087e4-bd05-4a10-86ad-dd9059820ce0"}} Jun 23 11:53:01.643081 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: method: > Jun 23 11:53:01.644060 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: exception: Invalid volume: volume 426087e4-bd05-4a10-86ad-dd9059820ce0 is already attached to instances: 284456f6-2347-46c7-bec1-2acb170b7421 Jun 23 11:53:01.644060 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: action_args: {'server_id': '284456f6-2347-46c7-bec1-2acb170b7421', 'body': {'volumeAttachment': {'volumeId': '426087e4-bd05-4a10-86ad-dd9059820ce0'}}} Jun 23 11:53:01.644060 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:53:01.644060 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:53:01.644060 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 23 11:53:01.644060 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 23 11:53:01.644060 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 23 11:53:01.644060 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 23 11:53:01.644060 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 23 11:53:01.644060 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 23 11:53:01.644060 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 23 11:53:01.644060 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 23 11:53:01.644060 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 23 11:53:01.644060 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 23 11:53:01.644060 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 426087e4-bd05-4a10-86ad-dd9059820ce0 is already attached to instances: 284456f6-2347-46c7-bec1-2acb170b7421 Jun 23 11:53:01.644060 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:53:01.644060 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:53:01.644060 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:53:01.644060 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:53:01.645632 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:53:01.645632 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:53:01.645632 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:53:01.645632 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:53:01.645632 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:53:01.645632 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:53:01.645632 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 11:53:01.645632 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 11:53:01.645632 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 11:53:01.645632 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 11:53:01.645632 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 11:53:01.645632 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 11:53:01.645632 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 23 11:53:01.645632 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 23 11:53:01.645632 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 426087e4-bd05-4a10-86ad-dd9059820ce0 is already attached to instances: 284456f6-2347-46c7-bec1-2acb170b7421 Jun 23 11:53:01.645632 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:53:01.645632 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:53:01.645632 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:53:01.645632 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:53:01.645632 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:53:01.647875 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:53:01.647875 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:53:01.647875 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:53:01.647875 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 426087e4-bd05-4a10-86ad-dd9059820ce0 is already attached to instances: 284456f6-2347-46c7-bec1-2acb170b7421 Jun 23 11:53:01.647875 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:53:01.647875 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-e7eb9a6d-adf8-4ace-af9c-b3ca46185850 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Returning 400 to user: Invalid volume: volume 426087e4-bd05-4a10-86ad-dd9059820ce0 is already attached to instances: 284456f6-2347-46c7-bec1-2acb170b7421 {{(pid=124669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:53:01.647875 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-e7eb9a6d-adf8-4ace-af9c-b3ca46185850 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "POST /compute/v2.1/servers/284456f6-2347-46c7-bec1-2acb170b7421/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096816 Jun 23 11:53:01.647875 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 437/905] 10.222.0.13 () {60 vars in 1322 bytes} [Thu Jun 23 11:53:01 2022] POST /compute/v2.1/servers/284456f6-2347-46c7-bec1-2acb170b7421/os-volume_attachments => generated 174 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 23 11:53:01.711201 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-121beb92-3e69-476a-8745-4abea0b15bcb tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:53:01.711777 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-121beb92-3e69-476a-8745-4abea0b15bcb tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 284456f6-2347-46c7-bec1-2acb170b7421] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:53:01.718869 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-121beb92-3e69-476a-8745-4abea0b15bcb tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:53:01.719382 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-121beb92-3e69-476a-8745-4abea0b15bcb tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:53:01.720373 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-121beb92-3e69-476a-8745-4abea0b15bcb tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:53:01.720855 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-121beb92-3e69-476a-8745-4abea0b15bcb tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:53:01.804627 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.objects.instance [None req-121beb92-3e69-476a-8745-4abea0b15bcb tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lazy-loading 'services' on Instance uuid 284456f6-2347-46c7-bec1-2acb170b7421 {{(pid=124670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:53:02.046621 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-121beb92-3e69-476a-8745-4abea0b15bcb tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "DELETE /compute/v2.1/servers/284456f6-2347-46c7-bec1-2acb170b7421/os-volume_attachments/426087e4-bd05-4a10-86ad-dd9059820ce0" status: 202 len: 0 microversion: 2.1 time: 0.340874 Jun 23 11:53:02.047209 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 469/906] 10.222.0.13 () {58 vars in 1415 bytes} [Thu Jun 23 11:53:01 2022] DELETE /compute/v2.1/servers/284456f6-2347-46c7-bec1-2acb170b7421/os-volume_attachments/426087e4-bd05-4a10-86ad-dd9059820ce0 => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 11:53:02.056041 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-4ae371d5-3946-4513-a374-8693c24d9f2c tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:53:02.056921 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-4ae371d5-3946-4513-a374-8693c24d9f2c tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 284456f6-2347-46c7-bec1-2acb170b7421] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:53:02.062965 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-4ae371d5-3946-4513-a374-8693c24d9f2c tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:53:02.067156 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-4ae371d5-3946-4513-a374-8693c24d9f2c tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:53:02.067156 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-4ae371d5-3946-4513-a374-8693c24d9f2c tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:53:02.067156 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-4ae371d5-3946-4513-a374-8693c24d9f2c tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:53:02.096480 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-4ae371d5-3946-4513-a374-8693c24d9f2c tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/284456f6-2347-46c7-bec1-2acb170b7421/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044931 Jun 23 11:53:02.101509 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 438/907] 10.222.0.13 () {58 vars in 1301 bytes} [Thu Jun 23 11:53:02 2022] GET /compute/v2.1/servers/284456f6-2347-46c7-bec1-2acb170b7421/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:53:03.109681 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-f946bec7-cc3a-4c47-925d-c6b9f902eef2 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:53:03.110826 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-f946bec7-cc3a-4c47-925d-c6b9f902eef2 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 284456f6-2347-46c7-bec1-2acb170b7421] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:53:03.117372 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-f946bec7-cc3a-4c47-925d-c6b9f902eef2 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:53:03.117825 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-f946bec7-cc3a-4c47-925d-c6b9f902eef2 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:53:03.118613 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-f946bec7-cc3a-4c47-925d-c6b9f902eef2 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:53:03.119221 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-f946bec7-cc3a-4c47-925d-c6b9f902eef2 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:53:03.153322 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-f946bec7-cc3a-4c47-925d-c6b9f902eef2 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/284456f6-2347-46c7-bec1-2acb170b7421/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048831 Jun 23 11:53:03.153970 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 470/908] 10.222.0.13 () {58 vars in 1301 bytes} [Thu Jun 23 11:53:03 2022] GET /compute/v2.1/servers/284456f6-2347-46c7-bec1-2acb170b7421/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:53:04.166953 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-508aadb1-8d04-4f8a-838e-71019b1ed808 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:53:04.167910 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-508aadb1-8d04-4f8a-838e-71019b1ed808 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 284456f6-2347-46c7-bec1-2acb170b7421] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:53:04.181348 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-508aadb1-8d04-4f8a-838e-71019b1ed808 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:53:04.181799 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-508aadb1-8d04-4f8a-838e-71019b1ed808 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:53:04.182603 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-508aadb1-8d04-4f8a-838e-71019b1ed808 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:53:04.183041 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-508aadb1-8d04-4f8a-838e-71019b1ed808 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:53:04.212951 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-508aadb1-8d04-4f8a-838e-71019b1ed808 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/284456f6-2347-46c7-bec1-2acb170b7421/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051514 Jun 23 11:53:04.213520 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 439/909] 10.222.0.13 () {58 vars in 1301 bytes} [Thu Jun 23 11:53:04 2022] GET /compute/v2.1/servers/284456f6-2347-46c7-bec1-2acb170b7421/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 11:53:04.273279 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-911924ef-6ef1-4f39-8e39-23e2be1045c1 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:53:04.273794 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-911924ef-6ef1-4f39-8e39-23e2be1045c1 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 284456f6-2347-46c7-bec1-2acb170b7421] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:53:04.280571 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-911924ef-6ef1-4f39-8e39-23e2be1045c1 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:53:04.281017 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-911924ef-6ef1-4f39-8e39-23e2be1045c1 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:53:04.281828 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-911924ef-6ef1-4f39-8e39-23e2be1045c1 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:53:04.282258 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-911924ef-6ef1-4f39-8e39-23e2be1045c1 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:53:04.308036 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-911924ef-6ef1-4f39-8e39-23e2be1045c1 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 284456f6-2347-46c7-bec1-2acb170b7421] Going to try to terminate instance {{(pid=124670) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 11:53:04.580893 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-911924ef-6ef1-4f39-8e39-23e2be1045c1 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "DELETE /compute/v2.1/servers/284456f6-2347-46c7-bec1-2acb170b7421" status: 204 len: 0 microversion: 2.1 time: 0.312743 Jun 23 11:53:04.581493 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 471/910] 10.222.0.13 () {58 vars in 1238 bytes} [Thu Jun 23 11:53:04 2022] DELETE /compute/v2.1/servers/284456f6-2347-46c7-bec1-2acb170b7421 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 11:53:04.590810 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-05a9339c-8393-4d28-838e-412b221cef47 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:53:04.591416 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-05a9339c-8393-4d28-838e-412b221cef47 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 284456f6-2347-46c7-bec1-2acb170b7421] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:53:04.597458 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-05a9339c-8393-4d28-838e-412b221cef47 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:53:04.597905 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-05a9339c-8393-4d28-838e-412b221cef47 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:53:04.598673 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-05a9339c-8393-4d28-838e-412b221cef47 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:53:04.599110 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-05a9339c-8393-4d28-838e-412b221cef47 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:53:04.739282 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-05a9339c-8393-4d28-838e-412b221cef47 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:53:04.747519 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-05a9339c-8393-4d28-838e-412b221cef47 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/284456f6-2347-46c7-bec1-2acb170b7421" status: 200 len: 1680 microversion: 2.1 time: 0.160577 Jun 23 11:53:04.748010 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 440/911] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:53:04 2022] GET /compute/v2.1/servers/284456f6-2347-46c7-bec1-2acb170b7421 => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:53:05.765651 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-1956200a-c38f-4647-ba6c-fb6b6c0dca56 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:53:05.766354 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-1956200a-c38f-4647-ba6c-fb6b6c0dca56 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 284456f6-2347-46c7-bec1-2acb170b7421] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:53:05.773867 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1956200a-c38f-4647-ba6c-fb6b6c0dca56 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:53:05.774315 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1956200a-c38f-4647-ba6c-fb6b6c0dca56 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:53:05.775123 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1956200a-c38f-4647-ba6c-fb6b6c0dca56 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:53:05.775559 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1956200a-c38f-4647-ba6c-fb6b6c0dca56 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:53:05.906823 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-1956200a-c38f-4647-ba6c-fb6b6c0dca56 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:53:05.914886 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-1956200a-c38f-4647-ba6c-fb6b6c0dca56 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/284456f6-2347-46c7-bec1-2acb170b7421" status: 200 len: 1680 microversion: 2.1 time: 0.153712 Jun 23 11:53:05.915465 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 472/912] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:53:05 2022] GET /compute/v2.1/servers/284456f6-2347-46c7-bec1-2acb170b7421 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:53:06.932913 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-0c099b70-5c1f-41ec-a0d4-bb929c748d58 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:53:06.933458 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-0c099b70-5c1f-41ec-a0d4-bb929c748d58 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 284456f6-2347-46c7-bec1-2acb170b7421] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:53:06.939985 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-0c099b70-5c1f-41ec-a0d4-bb929c748d58 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:53:06.940434 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-0c099b70-5c1f-41ec-a0d4-bb929c748d58 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:53:06.941184 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-0c099b70-5c1f-41ec-a0d4-bb929c748d58 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:53:06.941614 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-0c099b70-5c1f-41ec-a0d4-bb929c748d58 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:53:07.075799 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-0c099b70-5c1f-41ec-a0d4-bb929c748d58 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:53:07.083551 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-0c099b70-5c1f-41ec-a0d4-bb929c748d58 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/284456f6-2347-46c7-bec1-2acb170b7421" status: 200 len: 1680 microversion: 2.1 time: 0.155199 Jun 23 11:53:07.087497 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 441/913] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:53:06 2022] GET /compute/v2.1/servers/284456f6-2347-46c7-bec1-2acb170b7421 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:53:07.507810 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [req-fc97a4d2-3e7c-44d8-924e-8be46af742e0 req-17abb0f3-ce2f-4b9d-b3b4-2cda620bcf49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "284456f6-2347-46c7-bec1-2acb170b7421", "name": "network-vif-deleted", "tag": "22516136-8ac5-4a18-ba8f-bc1b5f85a4dd"}]} {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:53:07.515519 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-fc97a4d2-3e7c-44d8-924e-8be46af742e0 req-17abb0f3-ce2f-4b9d-b3b4-2cda620bcf49 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:53:07.515956 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-fc97a4d2-3e7c-44d8-924e-8be46af742e0 req-17abb0f3-ce2f-4b9d-b3b4-2cda620bcf49 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:53:07.527179 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.compute.server_external_events [req-fc97a4d2-3e7c-44d8-924e-8be46af742e0 req-17abb0f3-ce2f-4b9d-b3b4-2cda620bcf49 service nova] Creating event network-vif-deleted:22516136-8ac5-4a18-ba8f-bc1b5f85a4dd for instance 284456f6-2347-46c7-bec1-2acb170b7421 on hv-cinder-82099 Jun 23 11:53:07.532385 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [req-fc97a4d2-3e7c-44d8-924e-8be46af742e0 req-17abb0f3-ce2f-4b9d-b3b4-2cda620bcf49 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029160 Jun 23 11:53:07.533025 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 473/914] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:53:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:53:08.101497 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-0ac4ccd9-8da6-4300-b86e-181d41583de2 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:53:08.102245 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-0ac4ccd9-8da6-4300-b86e-181d41583de2 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 284456f6-2347-46c7-bec1-2acb170b7421] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:53:08.108684 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-0ac4ccd9-8da6-4300-b86e-181d41583de2 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:53:08.109137 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-0ac4ccd9-8da6-4300-b86e-181d41583de2 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:53:08.109901 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-0ac4ccd9-8da6-4300-b86e-181d41583de2 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:53:08.110344 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-0ac4ccd9-8da6-4300-b86e-181d41583de2 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:53:08.144926 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-0ac4ccd9-8da6-4300-b86e-181d41583de2 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:53:08.145385 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-0ac4ccd9-8da6-4300-b86e-181d41583de2 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:53:08.145847 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.objects.instance [None req-0ac4ccd9-8da6-4300-b86e-181d41583de2 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lazy-loading 'fault' on Instance uuid 284456f6-2347-46c7-bec1-2acb170b7421 {{(pid=124669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:53:08.192777 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-0ac4ccd9-8da6-4300-b86e-181d41583de2 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:53:08.203142 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-0ac4ccd9-8da6-4300-b86e-181d41583de2 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/284456f6-2347-46c7-bec1-2acb170b7421" status: 200 len: 1330 microversion: 2.1 time: 0.105839 Jun 23 11:53:08.203722 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 442/915] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:53:08 2022] GET /compute/v2.1/servers/284456f6-2347-46c7-bec1-2acb170b7421 => generated 1330 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:53:09.221826 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-a521bfc9-a4e2-45a5-a0af-ed48a9bfe20e tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:53:09.222517 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-a521bfc9-a4e2-45a5-a0af-ed48a9bfe20e tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 284456f6-2347-46c7-bec1-2acb170b7421] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:53:09.230329 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a521bfc9-a4e2-45a5-a0af-ed48a9bfe20e tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:53:09.230818 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a521bfc9-a4e2-45a5-a0af-ed48a9bfe20e tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:53:09.231577 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a521bfc9-a4e2-45a5-a0af-ed48a9bfe20e tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:53:09.232006 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a521bfc9-a4e2-45a5-a0af-ed48a9bfe20e tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:53:09.246726 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.wsgi [None req-a521bfc9-a4e2-45a5-a0af-ed48a9bfe20e tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] HTTP exception thrown: Instance 284456f6-2347-46c7-bec1-2acb170b7421 could not be found. Jun 23 11:53:09.248521 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-a521bfc9-a4e2-45a5-a0af-ed48a9bfe20e tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Request method failure captured: Jun 23 11:53:09.248521 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: request: GET /compute/v2.1/servers/284456f6-2347-46c7-bec1-2acb170b7421 HTTP/1.1 Jun 23 11:53:09.248521 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Accept: application/json Jun 23 11:53:09.248521 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Accept-Encoding: identity Jun 23 11:53:09.248521 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Connection: close Jun 23 11:53:09.248521 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Content-Length: 0 Jun 23 11:53:09.248521 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Content-Type: application/json Jun 23 11:53:09.248521 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Host: 10.222.0.13 Jun 23 11:53:09.248521 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Openstack-System-Scope: None Jun 23 11:53:09.248521 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: User-Agent: python-urllib3/1.26.9 Jun 23 11:53:09.248521 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Auth-Token: gAAAAABitFIKMke7vIBbvXT2RfPc-4frmGbwTZtMddIa6SPtgPblRzRqc8HMry6yk8WPdy-omEmS4IGKEBZ0krkMZ2AKKZ3XIi6QwXYCvuOyoif5_u-lfFNTFOpNeH9m810_qoSsO3823Vbqo3_NJM0PRtSxfQcTjP265INpx0gWYDOG-d8IrtY Jun 23 11:53:09.248521 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Domain-Id: None Jun 23 11:53:09.248521 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Domain-Name: None Jun 23 11:53:09.248521 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Identity-Status: Confirmed Jun 23 11:53:09.248521 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Is-Admin-Project: True Jun 23 11:53:09.248521 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Domain-Id: default Jun 23 11:53:09.248521 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Domain-Name: Default Jun 23 11:53:09.248521 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Id: ee135767dfc846469d64b658372994a8 Jun 23 11:53:09.248521 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Name: tempest-AttachVolumeNegativeTest-213077295 Jun 23 11:53:09.248521 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Role: member,reader Jun 23 11:53:09.248521 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Roles: member,reader Jun 23 11:53:09.250113 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ee135767dfc846469d64b658372994a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ee135767dfc846469d64b658372994a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ee135767dfc846469d64b658372994a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ee135767dfc846469d64b658372994a8"}]}] Jun 23 11:53:09.250113 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Tenant: tempest-AttachVolumeNegativeTest-213077295 Jun 23 11:53:09.250113 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Tenant-Id: ee135767dfc846469d64b658372994a8 Jun 23 11:53:09.250113 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-213077295 Jun 23 11:53:09.250113 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User: tempest-AttachVolumeNegativeTest-213077295-project Jun 23 11:53:09.250113 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Domain-Id: default Jun 23 11:53:09.250113 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Domain-Name: Default Jun 23 11:53:09.250113 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Id: b7fd8323d29d445f903e2103453e8ae6 Jun 23 11:53:09.250113 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Name: tempest-AttachVolumeNegativeTest-213077295-project Jun 23 11:53:09.250113 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: method: > Jun 23 11:53:09.250113 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: exception: Instance 284456f6-2347-46c7-bec1-2acb170b7421 could not be found. Jun 23 11:53:09.250113 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: action_args: {'id': '284456f6-2347-46c7-bec1-2acb170b7421'} Jun 23 11:53:09.251040 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:53:09.251040 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:53:09.251040 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:53:09.251040 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:53:09.251040 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:53:09.251040 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:53:09.251040 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:53:09.251040 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:53:09.251040 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:53:09.251040 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:53:09.251040 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 284456f6-2347-46c7-bec1-2acb170b7421 could not be found. Jun 23 11:53:09.251040 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:53:09.251040 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:53:09.251040 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:53:09.251040 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:53:09.251040 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:53:09.251040 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:53:09.251040 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:53:09.251040 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:53:09.251040 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:53:09.252532 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:53:09.252532 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 11:53:09.252532 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 11:53:09.252532 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:53:09.252532 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:53:09.252532 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:53:09.252532 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:53:09.252532 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 284456f6-2347-46c7-bec1-2acb170b7421 could not be found. Jun 23 11:53:09.252532 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:53:09.252532 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:53:09.252532 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:53:09.252532 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:53:09.252532 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:53:09.252532 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:53:09.252532 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:53:09.252532 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:53:09.252532 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 284456f6-2347-46c7-bec1-2acb170b7421 could not be found. Jun 23 11:53:09.252532 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:53:09.254225 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-a521bfc9-a4e2-45a5-a0af-ed48a9bfe20e tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Returning 404 to user: Instance 284456f6-2347-46c7-bec1-2acb170b7421 could not be found. {{(pid=124670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:53:09.254225 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-a521bfc9-a4e2-45a5-a0af-ed48a9bfe20e tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/284456f6-2347-46c7-bec1-2acb170b7421" status: 404 len: 111 microversion: 2.1 time: 0.032349 Jun 23 11:53:09.254225 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 474/916] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:53:09 2022] GET /compute/v2.1/servers/284456f6-2347-46c7-bec1-2acb170b7421 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:53:09.259422 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-585d1d17-d286-4dda-a828-128b9addf5ae tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '.version_select at 0x7f5d064c0670>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:53:09.345133 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-585d1d17-d286-4dda-a828-128b9addf5ae tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-112440455" status: 202 len: 0 microversion: 2.1 time: 0.090169 Jun 23 11:53:09.345696 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 443/917] 10.222.0.13 () {58 vars in 1217 bytes} [Thu Jun 23 11:53:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-112440455 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 11:53:10.150368 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-0b9bc6e1-9d3c-4d69-bc5e-47ea9b03e9cd tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Action: 'create', calling method: .version_select at 0x7f5d06617700>, body: {"keypair": {"name": "tempest-keypair-1357719903", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDKzbf2p5LFVBkFNneGjNbT/7Md5ruYNK9Flt26ynVEItTV2VG2c4gVXPuy9ne2EdyRLtXgh9ldB98ZKoUqAF5k3IFyiT6r5U6DCFcgy3Xpja3zrr8DqJ12gkdjPO4ADWQ=="}} {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:53:10.164186 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.quota [None req-0b9bc6e1-9d3c-4d69-bc5e-47ea9b03e9cd tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Getting quotas for project ee135767dfc846469d64b658372994a8. Resources: {'key_pairs'} {{(pid=124670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:53:10.167960 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.quota [None req-0b9bc6e1-9d3c-4d69-bc5e-47ea9b03e9cd tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Getting quotas for user b7fd8323d29d445f903e2103453e8ae6 and project ee135767dfc846469d64b658372994a8. Resources: {'key_pairs'} {{(pid=124670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:53:10.250257 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-0b9bc6e1-9d3c-4d69-bc5e-47ea9b03e9cd tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.103647 Jun 23 11:53:10.250961 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 475/918] 10.222.0.13 () {60 vars in 1158 bytes} [Thu Jun 23 11:53:10 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:53:12.751870 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-5faf4f64-2e7a-4098-882d-4a65971ad713 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-318730262", "imageRef": "b19d6f23-214c-4432-bee6-455978023759", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1be91f97-511d-47dc-890a-297123afd9f6"}], "security_groups": [{"name": "tempest-securitygroup--1240709394"}], "key_name": "tempest-keypair-1357719903", "user_data": "}} {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:53:12.851439 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.network.neutron [None req-5faf4f64-2e7a-4098-882d-4a65971ad713 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] validate_networks() for [('1be91f97-511d-47dc-890a-297123afd9f6', None, None, None, None, None)] {{(pid=124669) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 11:53:13.210108 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.virt.hardware [None req-5faf4f64-2e7a-4098-882d-4a65971ad713 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Flavor limits 0:0:0 {{(pid=124669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 11:53:13.210472 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.virt.hardware [None req-5faf4f64-2e7a-4098-882d-4a65971ad713 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Image limits 0:0:0 {{(pid=124669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 11:53:13.210974 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.virt.hardware [None req-5faf4f64-2e7a-4098-882d-4a65971ad713 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Flavor pref 0:0:0 {{(pid=124669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 11:53:13.211377 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.virt.hardware [None req-5faf4f64-2e7a-4098-882d-4a65971ad713 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Image pref 0:0:0 {{(pid=124669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 11:53:13.211783 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.virt.hardware [None req-5faf4f64-2e7a-4098-882d-4a65971ad713 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 11:53:13.220761 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-5faf4f64-2e7a-4098-882d-4a65971ad713 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:53:13.221201 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-5faf4f64-2e7a-4098-882d-4a65971ad713 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:53:13.221983 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-5faf4f64-2e7a-4098-882d-4a65971ad713 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:53:13.222415 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-5faf4f64-2e7a-4098-882d-4a65971ad713 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:53:13.241324 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.quota [None req-5faf4f64-2e7a-4098-882d-4a65971ad713 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Getting quotas for project ee135767dfc846469d64b658372994a8. Resources: {'cores', 'instances', 'ram'} {{(pid=124669) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:53:13.245832 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.quota [None req-5faf4f64-2e7a-4098-882d-4a65971ad713 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Getting quotas for user b7fd8323d29d445f903e2103453e8ae6 and project ee135767dfc846469d64b658372994a8. Resources: {'cores', 'instances', 'ram'} {{(pid=124669) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:53:13.256683 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-5faf4f64-2e7a-4098-882d-4a65971ad713 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Going to run 1 instances... {{(pid=124669) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 11:53:13.258903 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-5faf4f64-2e7a-4098-882d-4a65971ad713 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 6e9aaa29-4417-4225-b320-0f38cd075e59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b19d6f23-214c-4432-bee6-455978023759',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124669) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 11:53:13.380782 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-5faf4f64-2e7a-4098-882d-4a65971ad713 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.633206 Jun 23 11:53:13.381421 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 444/919] 10.222.0.13 () {60 vars in 1146 bytes} [Thu Jun 23 11:53:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 635 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 11:53:13.391969 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-adbe213c-bb89-4130-8542-961248b75669 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:53:13.392585 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-adbe213c-bb89-4130-8542-961248b75669 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 6e9aaa29-4417-4225-b320-0f38cd075e59] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:53:13.453492 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-adbe213c-bb89-4130-8542-961248b75669 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:53:13.460227 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-adbe213c-bb89-4130-8542-961248b75669 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/6e9aaa29-4417-4225-b320-0f38cd075e59" status: 200 len: 1241 microversion: 2.1 time: 0.072620 Jun 23 11:53:13.461028 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 476/920] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:53:13 2022] GET /compute/v2.1/servers/6e9aaa29-4417-4225-b320-0f38cd075e59 => generated 1241 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:53:14.477820 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-e45709d0-5a58-4357-ad15-fa51e0c6bfb4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:53:14.478419 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-e45709d0-5a58-4357-ad15-fa51e0c6bfb4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 6e9aaa29-4417-4225-b320-0f38cd075e59] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:53:14.484843 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-e45709d0-5a58-4357-ad15-fa51e0c6bfb4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:53:14.485418 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-e45709d0-5a58-4357-ad15-fa51e0c6bfb4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:53:14.486259 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-e45709d0-5a58-4357-ad15-fa51e0c6bfb4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:53:14.486819 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-e45709d0-5a58-4357-ad15-fa51e0c6bfb4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:53:14.550272 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-e45709d0-5a58-4357-ad15-fa51e0c6bfb4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:53:14.557758 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-e45709d0-5a58-4357-ad15-fa51e0c6bfb4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/6e9aaa29-4417-4225-b320-0f38cd075e59" status: 200 len: 1237 microversion: 2.1 time: 0.084517 Jun 23 11:53:14.558440 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 445/921] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:53:14 2022] GET /compute/v2.1/servers/6e9aaa29-4417-4225-b320-0f38cd075e59 => generated 1237 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:53:15.575145 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-c7de53f8-d9cd-4121-aef6-7af1466e2bc4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:53:15.576033 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-c7de53f8-d9cd-4121-aef6-7af1466e2bc4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 6e9aaa29-4417-4225-b320-0f38cd075e59] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:53:15.582634 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-c7de53f8-d9cd-4121-aef6-7af1466e2bc4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:53:15.583104 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-c7de53f8-d9cd-4121-aef6-7af1466e2bc4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:53:15.583868 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-c7de53f8-d9cd-4121-aef6-7af1466e2bc4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:53:15.584299 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-c7de53f8-d9cd-4121-aef6-7af1466e2bc4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:53:15.647077 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-c7de53f8-d9cd-4121-aef6-7af1466e2bc4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:53:15.655295 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-c7de53f8-d9cd-4121-aef6-7af1466e2bc4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/6e9aaa29-4417-4225-b320-0f38cd075e59" status: 200 len: 1299 microversion: 2.1 time: 0.084179 Jun 23 11:53:15.659507 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 477/922] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:53:15 2022] GET /compute/v2.1/servers/6e9aaa29-4417-4225-b320-0f38cd075e59 => generated 1299 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:53:16.674102 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-abfc3cd1-b3a5-4f16-a01d-cf099d87c5af tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:53:16.674774 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-abfc3cd1-b3a5-4f16-a01d-cf099d87c5af tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 6e9aaa29-4417-4225-b320-0f38cd075e59] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:53:16.681560 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-abfc3cd1-b3a5-4f16-a01d-cf099d87c5af tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:53:16.682009 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-abfc3cd1-b3a5-4f16-a01d-cf099d87c5af tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:53:16.683131 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-abfc3cd1-b3a5-4f16-a01d-cf099d87c5af tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:53:16.683584 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-abfc3cd1-b3a5-4f16-a01d-cf099d87c5af tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:53:16.814774 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-abfc3cd1-b3a5-4f16-a01d-cf099d87c5af tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:53:16.822294 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-abfc3cd1-b3a5-4f16-a01d-cf099d87c5af tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/6e9aaa29-4417-4225-b320-0f38cd075e59" status: 200 len: 1367 microversion: 2.1 time: 0.153508 Jun 23 11:53:16.823703 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 446/923] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:53:16 2022] GET /compute/v2.1/servers/6e9aaa29-4417-4225-b320-0f38cd075e59 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:53:16.877240 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [req-ec2ab200-105b-497a-b019-13620f519803 req-e0a5dd20-35ef-44a4-9db2-d401cfe045f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e9aaa29-4417-4225-b320-0f38cd075e59", "tag": "91673040-ce00-4c33-ac8c-8d94ff6b820a"}]} {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:53:16.891708 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-ec2ab200-105b-497a-b019-13620f519803 req-e0a5dd20-35ef-44a4-9db2-d401cfe045f1 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:53:16.892577 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-ec2ab200-105b-497a-b019-13620f519803 req-e0a5dd20-35ef-44a4-9db2-d401cfe045f1 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:53:16.904926 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.compute.server_external_events [req-ec2ab200-105b-497a-b019-13620f519803 req-e0a5dd20-35ef-44a4-9db2-d401cfe045f1 service nova] Creating event network-changed:91673040-ce00-4c33-ac8c-8d94ff6b820a for instance 6e9aaa29-4417-4225-b320-0f38cd075e59 on hv-cinder-82099 Jun 23 11:53:16.910058 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [req-ec2ab200-105b-497a-b019-13620f519803 req-e0a5dd20-35ef-44a4-9db2-d401cfe045f1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036687 Jun 23 11:53:16.910680 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 478/924] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:53:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:53:17.839732 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-c64b37d2-1f5e-4cca-bc3e-7d8a0dc18181 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:53:17.840345 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-c64b37d2-1f5e-4cca-bc3e-7d8a0dc18181 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 6e9aaa29-4417-4225-b320-0f38cd075e59] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:53:17.846867 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c64b37d2-1f5e-4cca-bc3e-7d8a0dc18181 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:53:17.847318 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c64b37d2-1f5e-4cca-bc3e-7d8a0dc18181 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:53:17.848071 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c64b37d2-1f5e-4cca-bc3e-7d8a0dc18181 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:53:17.848506 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c64b37d2-1f5e-4cca-bc3e-7d8a0dc18181 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:53:17.975774 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-c64b37d2-1f5e-4cca-bc3e-7d8a0dc18181 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:53:17.984401 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-c64b37d2-1f5e-4cca-bc3e-7d8a0dc18181 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/6e9aaa29-4417-4225-b320-0f38cd075e59" status: 200 len: 1367 microversion: 2.1 time: 0.148962 Jun 23 11:53:17.984910 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 447/925] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:53:17 2022] GET /compute/v2.1/servers/6e9aaa29-4417-4225-b320-0f38cd075e59 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:53:19.002661 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-1e2305ff-6a14-4ca6-bd93-3a53991c8b5c tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:53:19.003284 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-1e2305ff-6a14-4ca6-bd93-3a53991c8b5c tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 6e9aaa29-4417-4225-b320-0f38cd075e59] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:53:19.009908 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1e2305ff-6a14-4ca6-bd93-3a53991c8b5c tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:53:19.010347 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1e2305ff-6a14-4ca6-bd93-3a53991c8b5c tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:53:19.011752 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1e2305ff-6a14-4ca6-bd93-3a53991c8b5c tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:53:19.012183 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1e2305ff-6a14-4ca6-bd93-3a53991c8b5c tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:53:19.140437 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-1e2305ff-6a14-4ca6-bd93-3a53991c8b5c tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:53:19.149133 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-1e2305ff-6a14-4ca6-bd93-3a53991c8b5c tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/6e9aaa29-4417-4225-b320-0f38cd075e59" status: 200 len: 1367 microversion: 2.1 time: 0.150387 Jun 23 11:53:19.149768 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 479/926] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:53:18 2022] GET /compute/v2.1/servers/6e9aaa29-4417-4225-b320-0f38cd075e59 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:53:20.168263 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-664e56e1-8295-4907-9c20-9a6c05d8ce7f tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:53:20.168882 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-664e56e1-8295-4907-9c20-9a6c05d8ce7f tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 6e9aaa29-4417-4225-b320-0f38cd075e59] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:53:20.175397 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-664e56e1-8295-4907-9c20-9a6c05d8ce7f tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:53:20.175851 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-664e56e1-8295-4907-9c20-9a6c05d8ce7f tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:53:20.176612 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-664e56e1-8295-4907-9c20-9a6c05d8ce7f tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:53:20.177045 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-664e56e1-8295-4907-9c20-9a6c05d8ce7f tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:53:20.310191 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-664e56e1-8295-4907-9c20-9a6c05d8ce7f tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:53:20.317585 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-664e56e1-8295-4907-9c20-9a6c05d8ce7f tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/6e9aaa29-4417-4225-b320-0f38cd075e59" status: 200 len: 1367 microversion: 2.1 time: 0.153313 Jun 23 11:53:20.318135 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 448/927] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:53:20 2022] GET /compute/v2.1/servers/6e9aaa29-4417-4225-b320-0f38cd075e59 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:53:21.334927 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-c1e71463-0624-44a0-bb02-1e1ffe777c3b tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:53:21.335539 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-c1e71463-0624-44a0-bb02-1e1ffe777c3b tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 6e9aaa29-4417-4225-b320-0f38cd075e59] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:53:21.342779 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-c1e71463-0624-44a0-bb02-1e1ffe777c3b tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:53:21.343233 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-c1e71463-0624-44a0-bb02-1e1ffe777c3b tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:53:21.343989 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-c1e71463-0624-44a0-bb02-1e1ffe777c3b tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:53:21.344424 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-c1e71463-0624-44a0-bb02-1e1ffe777c3b tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:53:21.471057 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-c1e71463-0624-44a0-bb02-1e1ffe777c3b tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:53:21.478608 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-c1e71463-0624-44a0-bb02-1e1ffe777c3b tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/6e9aaa29-4417-4225-b320-0f38cd075e59" status: 200 len: 1367 microversion: 2.1 time: 0.147535 Jun 23 11:53:21.479170 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 480/928] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:53:21 2022] GET /compute/v2.1/servers/6e9aaa29-4417-4225-b320-0f38cd075e59 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:53:22.495976 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-0e54e2a7-4953-4d47-833f-40c783594880 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:53:22.496587 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-0e54e2a7-4953-4d47-833f-40c783594880 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 6e9aaa29-4417-4225-b320-0f38cd075e59] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:53:22.502810 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-0e54e2a7-4953-4d47-833f-40c783594880 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:53:22.503296 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-0e54e2a7-4953-4d47-833f-40c783594880 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:53:22.504066 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-0e54e2a7-4953-4d47-833f-40c783594880 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:53:22.504509 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-0e54e2a7-4953-4d47-833f-40c783594880 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:53:22.633592 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-0e54e2a7-4953-4d47-833f-40c783594880 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:53:22.642073 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-0e54e2a7-4953-4d47-833f-40c783594880 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/6e9aaa29-4417-4225-b320-0f38cd075e59" status: 200 len: 1367 microversion: 2.1 time: 0.150287 Jun 23 11:53:22.642648 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 449/929] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:53:22 2022] GET /compute/v2.1/servers/6e9aaa29-4417-4225-b320-0f38cd075e59 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:53:23.658994 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-00b45572-e456-428b-a8d1-1102bb96d920 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:53:23.659597 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-00b45572-e456-428b-a8d1-1102bb96d920 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 6e9aaa29-4417-4225-b320-0f38cd075e59] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:53:23.661727 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_cell0:SELECT=6 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:53:23.662401 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:53:23.667921 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-00b45572-e456-428b-a8d1-1102bb96d920 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:53:23.668410 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-00b45572-e456-428b-a8d1-1102bb96d920 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:53:23.669170 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-00b45572-e456-428b-a8d1-1102bb96d920 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:53:23.669600 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-00b45572-e456-428b-a8d1-1102bb96d920 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:53:23.673624 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:53:23.797553 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-00b45572-e456-428b-a8d1-1102bb96d920 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:53:23.804836 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-00b45572-e456-428b-a8d1-1102bb96d920 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/6e9aaa29-4417-4225-b320-0f38cd075e59" status: 200 len: 1367 microversion: 2.1 time: 0.149770 Jun 23 11:53:23.805397 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 481/930] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:53:23 2022] GET /compute/v2.1/servers/6e9aaa29-4417-4225-b320-0f38cd075e59 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:53:24.822371 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-5cd91ad9-b6b8-4b89-b80b-e71f1dd486de tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:53:24.823025 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-5cd91ad9-b6b8-4b89-b80b-e71f1dd486de tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 6e9aaa29-4417-4225-b320-0f38cd075e59] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:53:24.825533 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_cell0:SELECT=2 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:53:24.826318 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_cell0:SELECT=6 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:53:24.831600 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-5cd91ad9-b6b8-4b89-b80b-e71f1dd486de tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:53:24.834453 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-5cd91ad9-b6b8-4b89-b80b-e71f1dd486de tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:53:24.834453 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-5cd91ad9-b6b8-4b89-b80b-e71f1dd486de tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:53:24.834453 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-5cd91ad9-b6b8-4b89-b80b-e71f1dd486de tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:53:24.964849 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-5cd91ad9-b6b8-4b89-b80b-e71f1dd486de tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:53:24.972239 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-5cd91ad9-b6b8-4b89-b80b-e71f1dd486de tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/6e9aaa29-4417-4225-b320-0f38cd075e59" status: 200 len: 1367 microversion: 2.1 time: 0.153800 Jun 23 11:53:24.972792 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 450/931] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:53:24 2022] GET /compute/v2.1/servers/6e9aaa29-4417-4225-b320-0f38cd075e59 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:53:25.990063 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-48a398fa-05d6-41c5-9a7e-eb63321f191d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:53:25.990724 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-48a398fa-05d6-41c5-9a7e-eb63321f191d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 6e9aaa29-4417-4225-b320-0f38cd075e59] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:53:25.998676 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-48a398fa-05d6-41c5-9a7e-eb63321f191d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:53:25.999121 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-48a398fa-05d6-41c5-9a7e-eb63321f191d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:53:25.999870 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-48a398fa-05d6-41c5-9a7e-eb63321f191d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:53:26.000298 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-48a398fa-05d6-41c5-9a7e-eb63321f191d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:53:26.132958 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-48a398fa-05d6-41c5-9a7e-eb63321f191d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:53:26.140896 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-48a398fa-05d6-41c5-9a7e-eb63321f191d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/6e9aaa29-4417-4225-b320-0f38cd075e59" status: 200 len: 1367 microversion: 2.1 time: 0.155431 Jun 23 11:53:26.141490 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 482/932] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:53:25 2022] GET /compute/v2.1/servers/6e9aaa29-4417-4225-b320-0f38cd075e59 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:53:26.460565 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [req-c1240a5c-f320-4c78-87cf-23735b4ebb67 req-e2124093-ab59-4d07-984f-0c5d688168d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e9aaa29-4417-4225-b320-0f38cd075e59", "name": "network-vif-plugged", "status": "completed", "tag": "91673040-ce00-4c33-ac8c-8d94ff6b820a"}]} {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:53:26.469999 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [req-c1240a5c-f320-4c78-87cf-23735b4ebb67 req-e2124093-ab59-4d07-984f-0c5d688168d4 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:53:26.471527 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [req-c1240a5c-f320-4c78-87cf-23735b4ebb67 req-e2124093-ab59-4d07-984f-0c5d688168d4 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:53:26.482048 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.compute.server_external_events [req-c1240a5c-f320-4c78-87cf-23735b4ebb67 req-e2124093-ab59-4d07-984f-0c5d688168d4 service nova] Creating event network-vif-plugged:91673040-ce00-4c33-ac8c-8d94ff6b820a for instance 6e9aaa29-4417-4225-b320-0f38cd075e59 on hv-cinder-82099 Jun 23 11:53:26.489715 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [req-c1240a5c-f320-4c78-87cf-23735b4ebb67 req-e2124093-ab59-4d07-984f-0c5d688168d4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032494 Jun 23 11:53:26.490333 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 451/933] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:53:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:53:27.157025 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-828e121c-9a69-4367-8e6d-7c656fe50c2e tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:53:27.157633 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-828e121c-9a69-4367-8e6d-7c656fe50c2e tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 6e9aaa29-4417-4225-b320-0f38cd075e59] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:53:27.164057 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-828e121c-9a69-4367-8e6d-7c656fe50c2e tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:53:27.164509 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-828e121c-9a69-4367-8e6d-7c656fe50c2e tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:53:27.165296 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-828e121c-9a69-4367-8e6d-7c656fe50c2e tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:53:27.165731 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-828e121c-9a69-4367-8e6d-7c656fe50c2e tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:53:27.295158 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-828e121c-9a69-4367-8e6d-7c656fe50c2e tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:53:27.308002 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-828e121c-9a69-4367-8e6d-7c656fe50c2e tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/6e9aaa29-4417-4225-b320-0f38cd075e59" status: 200 len: 1367 microversion: 2.1 time: 0.154724 Jun 23 11:53:27.308583 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 483/934] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:53:27 2022] GET /compute/v2.1/servers/6e9aaa29-4417-4225-b320-0f38cd075e59 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:53:28.327038 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-8e845ba1-5541-4a90-93db-9ff923d464aa tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:53:28.327759 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-8e845ba1-5541-4a90-93db-9ff923d464aa tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 6e9aaa29-4417-4225-b320-0f38cd075e59] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:53:28.333962 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-8e845ba1-5541-4a90-93db-9ff923d464aa tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:53:28.334405 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-8e845ba1-5541-4a90-93db-9ff923d464aa tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:53:28.335178 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-8e845ba1-5541-4a90-93db-9ff923d464aa tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:53:28.335605 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-8e845ba1-5541-4a90-93db-9ff923d464aa tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:53:28.465787 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-8e845ba1-5541-4a90-93db-9ff923d464aa tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:53:28.473133 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-8e845ba1-5541-4a90-93db-9ff923d464aa tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/6e9aaa29-4417-4225-b320-0f38cd075e59" status: 200 len: 1367 microversion: 2.1 time: 0.151531 Jun 23 11:53:28.473686 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 452/935] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:53:28 2022] GET /compute/v2.1/servers/6e9aaa29-4417-4225-b320-0f38cd075e59 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:53:29.490563 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-8c3afb19-e8fb-456d-8f20-2e3a0851fee5 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:53:29.491242 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-8c3afb19-e8fb-456d-8f20-2e3a0851fee5 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 6e9aaa29-4417-4225-b320-0f38cd075e59] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:53:29.497917 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-8c3afb19-e8fb-456d-8f20-2e3a0851fee5 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:53:29.498380 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-8c3afb19-e8fb-456d-8f20-2e3a0851fee5 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:53:29.499164 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-8c3afb19-e8fb-456d-8f20-2e3a0851fee5 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:53:29.499626 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-8c3afb19-e8fb-456d-8f20-2e3a0851fee5 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:53:29.630505 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-8c3afb19-e8fb-456d-8f20-2e3a0851fee5 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:53:29.639700 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-8c3afb19-e8fb-456d-8f20-2e3a0851fee5 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/6e9aaa29-4417-4225-b320-0f38cd075e59" status: 200 len: 1558 microversion: 2.1 time: 0.152068 Jun 23 11:53:29.640268 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 484/936] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:53:29 2022] GET /compute/v2.1/servers/6e9aaa29-4417-4225-b320-0f38cd075e59 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:53:29.657038 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-fed3f7a8-47e3-43c1-92e5-1317ec422a3b tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:53:29.657605 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-fed3f7a8-47e3-43c1-92e5-1317ec422a3b tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 6e9aaa29-4417-4225-b320-0f38cd075e59] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:53:29.664222 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-fed3f7a8-47e3-43c1-92e5-1317ec422a3b tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:53:29.664672 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-fed3f7a8-47e3-43c1-92e5-1317ec422a3b tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:53:29.665435 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-fed3f7a8-47e3-43c1-92e5-1317ec422a3b tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:53:29.665874 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-fed3f7a8-47e3-43c1-92e5-1317ec422a3b tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:53:29.743353 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-fed3f7a8-47e3-43c1-92e5-1317ec422a3b tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/6e9aaa29-4417-4225-b320-0f38cd075e59/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090533 Jun 23 11:53:29.743941 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 453/937] 10.222.0.13 () {58 vars in 1274 bytes} [Thu Jun 23 11:53:29 2022] GET /compute/v2.1/servers/6e9aaa29-4417-4225-b320-0f38cd075e59/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:53:30.733744 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [req-d895091c-04a5-4459-aaea-2f22f26c99ec req-d7aed931-9567-4bce-af01-acadb95d3413 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e9aaa29-4417-4225-b320-0f38cd075e59", "tag": "91673040-ce00-4c33-ac8c-8d94ff6b820a"}]} {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:53:30.742715 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-d895091c-04a5-4459-aaea-2f22f26c99ec req-d7aed931-9567-4bce-af01-acadb95d3413 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:53:30.743245 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-d895091c-04a5-4459-aaea-2f22f26c99ec req-d7aed931-9567-4bce-af01-acadb95d3413 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:53:30.754584 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.compute.server_external_events [req-d895091c-04a5-4459-aaea-2f22f26c99ec req-d7aed931-9567-4bce-af01-acadb95d3413 service nova] Creating event network-changed:91673040-ce00-4c33-ac8c-8d94ff6b820a for instance 6e9aaa29-4417-4225-b320-0f38cd075e59 on hv-cinder-82099 Jun 23 11:53:30.759670 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [req-d895091c-04a5-4459-aaea-2f22f26c99ec req-d7aed931-9567-4bce-af01-acadb95d3413 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030698 Jun 23 11:53:30.760426 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 485/938] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:53:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:53:52.211709 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_api:SELECT=50,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:53:52.213390 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_cell1:SELECT=91 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:53:52.217541 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-e6e135f4-49d9-417a-9e1a-4fca701b0264 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-247759014", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-367548420", "security_groups": [{"name": "tempest-secgroup-smoke-1542660815"}], "block_device_mapping_v2": [{"uuid": "c78f7627-020c-453a-a4a9-68bd1b7ec7b7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "24cad3d6-9999-4d1e-ad9b-006e17356f41"}]}} {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:53:52.414429 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.network.neutron [None req-e6e135f4-49d9-417a-9e1a-4fca701b0264 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] validate_networks() for [('24cad3d6-9999-4d1e-ad9b-006e17356f41', None, None, None, None, None)] {{(pid=124669) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 11:53:53.016249 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.virt.hardware [None req-e6e135f4-49d9-417a-9e1a-4fca701b0264 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Flavor limits 0:0:0 {{(pid=124669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 11:53:53.016808 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.virt.hardware [None req-e6e135f4-49d9-417a-9e1a-4fca701b0264 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Image limits 0:0:0 {{(pid=124669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 11:53:53.017499 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.virt.hardware [None req-e6e135f4-49d9-417a-9e1a-4fca701b0264 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Flavor pref 0:0:0 {{(pid=124669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 11:53:53.017935 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.virt.hardware [None req-e6e135f4-49d9-417a-9e1a-4fca701b0264 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Image pref 0:0:0 {{(pid=124669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 11:53:53.018339 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.virt.hardware [None req-e6e135f4-49d9-417a-9e1a-4fca701b0264 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 11:53:53.028557 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-e6e135f4-49d9-417a-9e1a-4fca701b0264 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:53:53.029006 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-e6e135f4-49d9-417a-9e1a-4fca701b0264 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:53:53.029795 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-e6e135f4-49d9-417a-9e1a-4fca701b0264 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:53:53.030453 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-e6e135f4-49d9-417a-9e1a-4fca701b0264 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:53:53.052775 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.quota [None req-e6e135f4-49d9-417a-9e1a-4fca701b0264 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Getting quotas for project 2e810a9bc3b44c4aa8ca2ddd0fa68f7b. Resources: {'cores', 'instances', 'ram'} {{(pid=124669) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:53:53.061282 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.quota [None req-e6e135f4-49d9-417a-9e1a-4fca701b0264 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Getting quotas for user 6cc5a4676f6a416cbdc8c67ebd80cdf3 and project 2e810a9bc3b44c4aa8ca2ddd0fa68f7b. Resources: {'cores', 'instances', 'ram'} {{(pid=124669) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:53:53.144569 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-e6e135f4-49d9-417a-9e1a-4fca701b0264 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Going to run 1 instances... {{(pid=124669) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 11:53:53.147161 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-e6e135f4-49d9-417a-9e1a-4fca701b0264 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] [instance: 6eefd0c5-c18b-435a-ac13-1a69019d4699] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c78f7627-020c-453a-a4a9-68bd1b7ec7b7',volume_size=None,volume_type=None)] {{(pid=124669) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 11:53:53.548358 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-e6e135f4-49d9-417a-9e1a-4fca701b0264 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.332750 Jun 23 11:53:53.548944 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 454/939] 10.222.0.13 () {60 vars in 1146 bytes} [Thu Jun 23 11:53:52 2022] POST /compute/v2.1/servers => generated 406 bytes in 1339 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 11:53:53.553740 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_api:SELECT=9 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:53:53.559422 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_cell1:SELECT=25 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:53:53.567815 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-d1095a1a-733e-4881-8c13-ed0052c0f459 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:53:53.568852 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-d1095a1a-733e-4881-8c13-ed0052c0f459 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] [instance: 6eefd0c5-c18b-435a-ac13-1a69019d4699] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:53:53.672793 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-d1095a1a-733e-4881-8c13-ed0052c0f459 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc5a4676f6a416cbdc8c67ebd80cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e810a9bc3b44c4aa8ca2ddd0fa68f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:53:53.685276 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-d1095a1a-733e-4881-8c13-ed0052c0f459 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] 10.222.0.13 "GET /compute/v2.1/servers/6eefd0c5-c18b-435a-ac13-1a69019d4699" status: 200 len: 1093 microversion: 2.1 time: 0.129248 Jun 23 11:53:53.685276 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 486/940] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:53:53 2022] GET /compute/v2.1/servers/6eefd0c5-c18b-435a-ac13-1a69019d4699 => generated 1093 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:53:53.726396 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-8705561f-920b-47d5-9902-462065709311 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:53:53.726932 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-8705561f-920b-47d5-9902-462065709311 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:53:53.734985 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-8705561f-920b-47d5-9902-462065709311 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:53:53.735768 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-8705561f-920b-47d5-9902-462065709311 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:53:53.736762 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-8705561f-920b-47d5-9902-462065709311 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:53:53.739465 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-8705561f-920b-47d5-9902-462065709311 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:53:53.771876 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-8705561f-920b-47d5-9902-462065709311 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143/ips" status: 200 len: 153 microversion: 2.20 time: 0.049915 Jun 23 11:53:53.773349 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 455/941] 10.222.0.13 () {60 vars in 1288 bytes} [Thu Jun 23 11:53:53 2022] GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143/ips => generated 153 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 11:53:54.700914 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-bac962ac-bca2-449a-bd1f-44a079c24c06 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:53:54.702277 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-bac962ac-bca2-449a-bd1f-44a079c24c06 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] [instance: 6eefd0c5-c18b-435a-ac13-1a69019d4699] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:53:54.710683 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-bac962ac-bca2-449a-bd1f-44a079c24c06 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:53:54.716709 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-bac962ac-bca2-449a-bd1f-44a079c24c06 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:53:54.716709 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-bac962ac-bca2-449a-bd1f-44a079c24c06 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:53:54.716709 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-bac962ac-bca2-449a-bd1f-44a079c24c06 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:53:54.782435 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-bac962ac-bca2-449a-bd1f-44a079c24c06 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc5a4676f6a416cbdc8c67ebd80cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e810a9bc3b44c4aa8ca2ddd0fa68f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:53:54.791351 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-bac962ac-bca2-449a-bd1f-44a079c24c06 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] 10.222.0.13 "GET /compute/v2.1/servers/6eefd0c5-c18b-435a-ac13-1a69019d4699" status: 200 len: 1143 microversion: 2.1 time: 0.094345 Jun 23 11:53:54.792124 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 487/942] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:53:54 2022] GET /compute/v2.1/servers/6eefd0c5-c18b-435a-ac13-1a69019d4699 => generated 1143 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:53:55.807800 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-1851a233-5847-44bf-9e4b-83b007391eeb tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:53:55.808377 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-1851a233-5847-44bf-9e4b-83b007391eeb tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] [instance: 6eefd0c5-c18b-435a-ac13-1a69019d4699] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:53:55.814950 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-1851a233-5847-44bf-9e4b-83b007391eeb tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:53:55.815973 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-1851a233-5847-44bf-9e4b-83b007391eeb tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:53:55.816834 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-1851a233-5847-44bf-9e4b-83b007391eeb tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:53:55.817277 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-1851a233-5847-44bf-9e4b-83b007391eeb tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:53:55.888098 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-1851a233-5847-44bf-9e4b-83b007391eeb tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc5a4676f6a416cbdc8c67ebd80cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e810a9bc3b44c4aa8ca2ddd0fa68f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:53:55.899768 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-1851a233-5847-44bf-9e4b-83b007391eeb tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] 10.222.0.13 "GET /compute/v2.1/servers/6eefd0c5-c18b-435a-ac13-1a69019d4699" status: 200 len: 1191 microversion: 2.1 time: 0.095984 Jun 23 11:53:55.900669 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 456/943] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:53:55 2022] GET /compute/v2.1/servers/6eefd0c5-c18b-435a-ac13-1a69019d4699 => generated 1191 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:53:56.918418 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-a70c9ea6-04d4-4984-9732-44a03ab356a7 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:53:56.919072 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-a70c9ea6-04d4-4984-9732-44a03ab356a7 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] [instance: 6eefd0c5-c18b-435a-ac13-1a69019d4699] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:53:56.936250 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a70c9ea6-04d4-4984-9732-44a03ab356a7 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:53:56.936250 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a70c9ea6-04d4-4984-9732-44a03ab356a7 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:53:56.936250 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a70c9ea6-04d4-4984-9732-44a03ab356a7 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:53:56.936250 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a70c9ea6-04d4-4984-9732-44a03ab356a7 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:53:57.199143 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-a784854b-81fb-4998-840f-12ecf670d724 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:53:57.201919 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-a784854b-81fb-4998-840f-12ecf670d724 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:53:57.219782 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-a784854b-81fb-4998-840f-12ecf670d724 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:53:57.220882 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-a784854b-81fb-4998-840f-12ecf670d724 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:53:57.222908 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-a784854b-81fb-4998-840f-12ecf670d724 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:53:57.223357 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-a784854b-81fb-4998-840f-12ecf670d724 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:53:57.289625 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.objects.instance [None req-a784854b-81fb-4998-840f-12ecf670d724 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lazy-loading 'flavor' on Instance uuid 1e51258d-c99d-4d15-8463-c699bcfa9143 {{(pid=124669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:53:57.493683 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-a70c9ea6-04d4-4984-9732-44a03ab356a7 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc5a4676f6a416cbdc8c67ebd80cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e810a9bc3b44c4aa8ca2ddd0fa68f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:53:57.524929 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-a70c9ea6-04d4-4984-9732-44a03ab356a7 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] 10.222.0.13 "GET /compute/v2.1/servers/6eefd0c5-c18b-435a-ac13-1a69019d4699" status: 200 len: 1277 microversion: 2.1 time: 0.610133 Jun 23 11:53:57.526090 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 488/944] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:53:56 2022] GET /compute/v2.1/servers/6eefd0c5-c18b-435a-ac13-1a69019d4699 => generated 1277 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:53:58.036464 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-a784854b-81fb-4998-840f-12ecf670d724 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "POST /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143/action" status: 202 len: 0 microversion: 2.20 time: 0.851857 Jun 23 11:53:58.037296 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 457/945] 10.222.0.13 () {62 vars in 1318 bytes} [Thu Jun 23 11:53:57 2022] POST /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143/action => generated 0 bytes in 853 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 23 11:53:58.045807 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-fdddd7ef-67fe-44b6-b6d7-2cef86d9acb5 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:53:58.047249 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-fdddd7ef-67fe-44b6-b6d7-2cef86d9acb5 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:53:58.061555 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-fdddd7ef-67fe-44b6-b6d7-2cef86d9acb5 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:53:58.081764 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-fdddd7ef-67fe-44b6-b6d7-2cef86d9acb5 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:53:58.087492 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-fdddd7ef-67fe-44b6-b6d7-2cef86d9acb5 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:53:58.087492 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-fdddd7ef-67fe-44b6-b6d7-2cef86d9acb5 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:53:58.544194 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-a9159cbd-dfea-42be-bbf6-c667c2e5d1f7 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:53:58.544899 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-a9159cbd-dfea-42be-bbf6-c667c2e5d1f7 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] [instance: 6eefd0c5-c18b-435a-ac13-1a69019d4699] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:53:58.564887 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-a9159cbd-dfea-42be-bbf6-c667c2e5d1f7 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:53:58.565541 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-a9159cbd-dfea-42be-bbf6-c667c2e5d1f7 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:53:58.566343 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-a9159cbd-dfea-42be-bbf6-c667c2e5d1f7 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:53:58.566801 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-a9159cbd-dfea-42be-bbf6-c667c2e5d1f7 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:53:58.657107 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-fdddd7ef-67fe-44b6-b6d7-2cef86d9acb5 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:53:58.667647 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-fdddd7ef-67fe-44b6-b6d7-2cef86d9acb5 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:53:58.670458 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-fdddd7ef-67fe-44b6-b6d7-2cef86d9acb5 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:53:58.672016 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-fdddd7ef-67fe-44b6-b6d7-2cef86d9acb5 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143" status: 200 len: 1725 microversion: 2.20 time: 0.630651 Jun 23 11:53:58.673123 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 489/946] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:53:58 2022] GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 => generated 1725 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:53:58.760032 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [req-3ba7a3a4-0366-4f04-93f6-78ab46a3a832 req-c7b4d279-7e7e-4ffc-ac30-a7ce358f0862 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6eefd0c5-c18b-435a-ac13-1a69019d4699", "tag": "2de3e3ea-22ec-4a86-899e-8c17d01954c3"}]} {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:53:58.780484 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-3ba7a3a4-0366-4f04-93f6-78ab46a3a832 req-c7b4d279-7e7e-4ffc-ac30-a7ce358f0862 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:53:58.780931 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-3ba7a3a4-0366-4f04-93f6-78ab46a3a832 req-c7b4d279-7e7e-4ffc-ac30-a7ce358f0862 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:53:58.803424 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.compute.server_external_events [req-3ba7a3a4-0366-4f04-93f6-78ab46a3a832 req-c7b4d279-7e7e-4ffc-ac30-a7ce358f0862 service nova] Creating event network-changed:2de3e3ea-22ec-4a86-899e-8c17d01954c3 for instance 6eefd0c5-c18b-435a-ac13-1a69019d4699 on hv-cinder-82099 Jun 23 11:53:58.816951 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [req-3ba7a3a4-0366-4f04-93f6-78ab46a3a832 req-c7b4d279-7e7e-4ffc-ac30-a7ce358f0862 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061273 Jun 23 11:53:58.817560 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 490/947] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:53:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:53:58.853484 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-a9159cbd-dfea-42be-bbf6-c667c2e5d1f7 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc5a4676f6a416cbdc8c67ebd80cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e810a9bc3b44c4aa8ca2ddd0fa68f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:53:58.870836 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-a9159cbd-dfea-42be-bbf6-c667c2e5d1f7 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] 10.222.0.13 "GET /compute/v2.1/servers/6eefd0c5-c18b-435a-ac13-1a69019d4699" status: 200 len: 1265 microversion: 2.1 time: 0.325574 Jun 23 11:53:58.872079 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 458/948] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:53:58 2022] GET /compute/v2.1/servers/6eefd0c5-c18b-435a-ac13-1a69019d4699 => generated 1265 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:53:59.694347 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-44adb952-cef1-4acc-9a4c-d1ca88188f12 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:53:59.695883 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-44adb952-cef1-4acc-9a4c-d1ca88188f12 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:53:59.704971 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-44adb952-cef1-4acc-9a4c-d1ca88188f12 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:53:59.705423 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-44adb952-cef1-4acc-9a4c-d1ca88188f12 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:53:59.706500 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-44adb952-cef1-4acc-9a4c-d1ca88188f12 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:53:59.706781 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-44adb952-cef1-4acc-9a4c-d1ca88188f12 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:53:59.891105 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-b83749d8-7221-46a4-bbfb-80fdadac54ec tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:53:59.891892 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-b83749d8-7221-46a4-bbfb-80fdadac54ec tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] [instance: 6eefd0c5-c18b-435a-ac13-1a69019d4699] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:53:59.900976 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-b83749d8-7221-46a4-bbfb-80fdadac54ec tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:53:59.901940 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-b83749d8-7221-46a4-bbfb-80fdadac54ec tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:53:59.902934 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-b83749d8-7221-46a4-bbfb-80fdadac54ec tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:53:59.903434 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-b83749d8-7221-46a4-bbfb-80fdadac54ec tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:53:59.911258 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-44adb952-cef1-4acc-9a4c-d1ca88188f12 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:53:59.919551 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-44adb952-cef1-4acc-9a4c-d1ca88188f12 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:53:59.927191 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-44adb952-cef1-4acc-9a4c-d1ca88188f12 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:53:59.928470 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-44adb952-cef1-4acc-9a4c-d1ca88188f12 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143" status: 200 len: 1725 microversion: 2.20 time: 0.240208 Jun 23 11:53:59.939448 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 491/949] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:53:59 2022] GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 => generated 1725 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:54:00.148803 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-b83749d8-7221-46a4-bbfb-80fdadac54ec tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc5a4676f6a416cbdc8c67ebd80cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e810a9bc3b44c4aa8ca2ddd0fa68f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:00.167257 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-b83749d8-7221-46a4-bbfb-80fdadac54ec tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] 10.222.0.13 "GET /compute/v2.1/servers/6eefd0c5-c18b-435a-ac13-1a69019d4699" status: 200 len: 1265 microversion: 2.1 time: 0.271456 Jun 23 11:54:00.167257 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 459/950] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:53:59 2022] GET /compute/v2.1/servers/6eefd0c5-c18b-435a-ac13-1a69019d4699 => generated 1265 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:54:00.948557 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-42ce772b-eb35-4393-a94e-d7cb2f5cd002 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:00.949248 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-42ce772b-eb35-4393-a94e-d7cb2f5cd002 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:00.962613 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-42ce772b-eb35-4393-a94e-d7cb2f5cd002 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:00.963341 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-42ce772b-eb35-4393-a94e-d7cb2f5cd002 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:00.964322 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-42ce772b-eb35-4393-a94e-d7cb2f5cd002 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:00.964945 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-42ce772b-eb35-4393-a94e-d7cb2f5cd002 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:01.176604 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-37282ce6-79b9-4b8a-b76f-a8ea576748b9 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:01.177836 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-37282ce6-79b9-4b8a-b76f-a8ea576748b9 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] [instance: 6eefd0c5-c18b-435a-ac13-1a69019d4699] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:01.185213 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-37282ce6-79b9-4b8a-b76f-a8ea576748b9 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:01.185743 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-37282ce6-79b9-4b8a-b76f-a8ea576748b9 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:01.186638 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-37282ce6-79b9-4b8a-b76f-a8ea576748b9 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:01.187153 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-37282ce6-79b9-4b8a-b76f-a8ea576748b9 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:01.253020 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-42ce772b-eb35-4393-a94e-d7cb2f5cd002 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:01.265960 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-42ce772b-eb35-4393-a94e-d7cb2f5cd002 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:01.269140 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-42ce772b-eb35-4393-a94e-d7cb2f5cd002 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:01.270685 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-42ce772b-eb35-4393-a94e-d7cb2f5cd002 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143" status: 200 len: 1725 microversion: 2.20 time: 0.327111 Jun 23 11:54:01.271818 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 492/951] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:54:00 2022] GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 => generated 1725 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:54:01.449079 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-37282ce6-79b9-4b8a-b76f-a8ea576748b9 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc5a4676f6a416cbdc8c67ebd80cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e810a9bc3b44c4aa8ca2ddd0fa68f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:01.458810 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-37282ce6-79b9-4b8a-b76f-a8ea576748b9 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] 10.222.0.13 "GET /compute/v2.1/servers/6eefd0c5-c18b-435a-ac13-1a69019d4699" status: 200 len: 1265 microversion: 2.1 time: 0.286312 Jun 23 11:54:01.460468 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 460/952] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:54:01 2022] GET /compute/v2.1/servers/6eefd0c5-c18b-435a-ac13-1a69019d4699 => generated 1265 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:54:02.289167 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-28fdfa9a-2ddd-4f22-9874-2a05a794d54b tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:02.289721 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-28fdfa9a-2ddd-4f22-9874-2a05a794d54b tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:02.296150 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-28fdfa9a-2ddd-4f22-9874-2a05a794d54b tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:02.296670 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-28fdfa9a-2ddd-4f22-9874-2a05a794d54b tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:02.297432 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-28fdfa9a-2ddd-4f22-9874-2a05a794d54b tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:02.297866 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-28fdfa9a-2ddd-4f22-9874-2a05a794d54b tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:02.476911 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-b5b6e952-c4a2-44aa-af1d-eb4871b37f95 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:02.477819 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-b5b6e952-c4a2-44aa-af1d-eb4871b37f95 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] [instance: 6eefd0c5-c18b-435a-ac13-1a69019d4699] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:02.490030 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-b5b6e952-c4a2-44aa-af1d-eb4871b37f95 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:02.490804 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-b5b6e952-c4a2-44aa-af1d-eb4871b37f95 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:02.491817 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-b5b6e952-c4a2-44aa-af1d-eb4871b37f95 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:02.492462 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-b5b6e952-c4a2-44aa-af1d-eb4871b37f95 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:02.717360 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-b5b6e952-c4a2-44aa-af1d-eb4871b37f95 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc5a4676f6a416cbdc8c67ebd80cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e810a9bc3b44c4aa8ca2ddd0fa68f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:02.727045 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-b5b6e952-c4a2-44aa-af1d-eb4871b37f95 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] 10.222.0.13 "GET /compute/v2.1/servers/6eefd0c5-c18b-435a-ac13-1a69019d4699" status: 200 len: 1265 microversion: 2.1 time: 0.253962 Jun 23 11:54:02.727563 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-28fdfa9a-2ddd-4f22-9874-2a05a794d54b tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:02.735964 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-28fdfa9a-2ddd-4f22-9874-2a05a794d54b tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:02.736450 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 461/953] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:54:02 2022] GET /compute/v2.1/servers/6eefd0c5-c18b-435a-ac13-1a69019d4699 => generated 1265 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:54:02.738405 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-28fdfa9a-2ddd-4f22-9874-2a05a794d54b tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:02.739826 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-28fdfa9a-2ddd-4f22-9874-2a05a794d54b tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143" status: 200 len: 1725 microversion: 2.20 time: 0.454403 Jun 23 11:54:02.740371 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 493/954] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:54:02 2022] GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 => generated 1725 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:54:03.745054 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-d8ebebd3-6b70-4cab-849d-ce97e2c16e49 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:03.746501 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-d8ebebd3-6b70-4cab-849d-ce97e2c16e49 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] [instance: 6eefd0c5-c18b-435a-ac13-1a69019d4699] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:03.752419 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_cell0:SELECT=2 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:54:03.754000 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_cell0:SELECT=6 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:54:03.757050 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-d8ebebd3-6b70-4cab-849d-ce97e2c16e49 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:03.757742 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-d8ebebd3-6b70-4cab-849d-ce97e2c16e49 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:03.759688 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-d8ebebd3-6b70-4cab-849d-ce97e2c16e49 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:03.760326 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-d8ebebd3-6b70-4cab-849d-ce97e2c16e49 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:03.761936 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-9681d0f5-13a8-42d5-aefc-90828c4d22a0 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:03.765024 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-9681d0f5-13a8-42d5-aefc-90828c4d22a0 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:03.774485 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_cell0:SELECT=2 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:54:03.776104 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-9681d0f5-13a8-42d5-aefc-90828c4d22a0 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:03.783965 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-9681d0f5-13a8-42d5-aefc-90828c4d22a0 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:03.787283 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-9681d0f5-13a8-42d5-aefc-90828c4d22a0 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:03.787956 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-9681d0f5-13a8-42d5-aefc-90828c4d22a0 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:04.035331 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-d8ebebd3-6b70-4cab-849d-ce97e2c16e49 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc5a4676f6a416cbdc8c67ebd80cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e810a9bc3b44c4aa8ca2ddd0fa68f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:04.039490 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-9681d0f5-13a8-42d5-aefc-90828c4d22a0 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:04.047073 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-d8ebebd3-6b70-4cab-849d-ce97e2c16e49 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] 10.222.0.13 "GET /compute/v2.1/servers/6eefd0c5-c18b-435a-ac13-1a69019d4699" status: 200 len: 1265 microversion: 2.1 time: 0.305641 Jun 23 11:54:04.048848 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 462/955] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:54:03 2022] GET /compute/v2.1/servers/6eefd0c5-c18b-435a-ac13-1a69019d4699 => generated 1265 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:54:04.051127 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-9681d0f5-13a8-42d5-aefc-90828c4d22a0 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:04.052856 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-9681d0f5-13a8-42d5-aefc-90828c4d22a0 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:04.054205 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-9681d0f5-13a8-42d5-aefc-90828c4d22a0 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143" status: 200 len: 1725 microversion: 2.20 time: 0.297502 Jun 23 11:54:04.064447 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 494/956] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:54:03 2022] GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 => generated 1725 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:54:05.066998 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-398f4b74-acab-450d-bb47-30e90347d7ff tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:05.068118 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-398f4b74-acab-450d-bb47-30e90347d7ff tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] [instance: 6eefd0c5-c18b-435a-ac13-1a69019d4699] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:05.079454 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-5fadc0d1-514b-4e06-b2f7-f9057d91cb81 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:05.082558 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-5fadc0d1-514b-4e06-b2f7-f9057d91cb81 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:05.096579 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-398f4b74-acab-450d-bb47-30e90347d7ff tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:05.099828 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-5fadc0d1-514b-4e06-b2f7-f9057d91cb81 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:05.099828 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-5fadc0d1-514b-4e06-b2f7-f9057d91cb81 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:05.099828 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-5fadc0d1-514b-4e06-b2f7-f9057d91cb81 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:05.099828 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-5fadc0d1-514b-4e06-b2f7-f9057d91cb81 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:05.100337 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-398f4b74-acab-450d-bb47-30e90347d7ff tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:05.111583 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-398f4b74-acab-450d-bb47-30e90347d7ff tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:05.115406 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-398f4b74-acab-450d-bb47-30e90347d7ff tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:05.302564 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-5fadc0d1-514b-4e06-b2f7-f9057d91cb81 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:05.312514 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-5fadc0d1-514b-4e06-b2f7-f9057d91cb81 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:05.371009 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-5fadc0d1-514b-4e06-b2f7-f9057d91cb81 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:05.371009 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-5fadc0d1-514b-4e06-b2f7-f9057d91cb81 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143" status: 200 len: 1725 microversion: 2.20 time: 0.244240 Jun 23 11:54:05.371009 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 495/957] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:54:05 2022] GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 => generated 1725 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:54:05.741607 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-398f4b74-acab-450d-bb47-30e90347d7ff tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc5a4676f6a416cbdc8c67ebd80cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e810a9bc3b44c4aa8ca2ddd0fa68f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:05.753777 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-398f4b74-acab-450d-bb47-30e90347d7ff tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] 10.222.0.13 "GET /compute/v2.1/servers/6eefd0c5-c18b-435a-ac13-1a69019d4699" status: 200 len: 1265 microversion: 2.1 time: 0.691237 Jun 23 11:54:05.754360 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 463/958] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:54:05 2022] GET /compute/v2.1/servers/6eefd0c5-c18b-435a-ac13-1a69019d4699 => generated 1265 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:54:06.338013 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-644e1e9d-7e9d-48da-9c80-54bd4e1c5730 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:06.338704 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-644e1e9d-7e9d-48da-9c80-54bd4e1c5730 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:06.345529 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-644e1e9d-7e9d-48da-9c80-54bd4e1c5730 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:06.345979 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-644e1e9d-7e9d-48da-9c80-54bd4e1c5730 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:06.347502 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-644e1e9d-7e9d-48da-9c80-54bd4e1c5730 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:06.349329 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-644e1e9d-7e9d-48da-9c80-54bd4e1c5730 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:06.499065 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-644e1e9d-7e9d-48da-9c80-54bd4e1c5730 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:06.509107 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-644e1e9d-7e9d-48da-9c80-54bd4e1c5730 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:06.510569 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-644e1e9d-7e9d-48da-9c80-54bd4e1c5730 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:06.511772 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-644e1e9d-7e9d-48da-9c80-54bd4e1c5730 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143" status: 200 len: 1725 microversion: 2.20 time: 0.177943 Jun 23 11:54:06.522953 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 496/959] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:54:06 2022] GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 => generated 1725 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:54:06.771173 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-83fe7e3b-c73c-4d55-a7cb-caac7b781f21 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:06.771884 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-83fe7e3b-c73c-4d55-a7cb-caac7b781f21 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] [instance: 6eefd0c5-c18b-435a-ac13-1a69019d4699] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:06.778625 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-83fe7e3b-c73c-4d55-a7cb-caac7b781f21 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:06.779412 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-83fe7e3b-c73c-4d55-a7cb-caac7b781f21 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:06.780429 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-83fe7e3b-c73c-4d55-a7cb-caac7b781f21 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:06.781074 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-83fe7e3b-c73c-4d55-a7cb-caac7b781f21 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:06.973100 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-83fe7e3b-c73c-4d55-a7cb-caac7b781f21 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc5a4676f6a416cbdc8c67ebd80cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e810a9bc3b44c4aa8ca2ddd0fa68f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:06.981984 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-83fe7e3b-c73c-4d55-a7cb-caac7b781f21 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] 10.222.0.13 "GET /compute/v2.1/servers/6eefd0c5-c18b-435a-ac13-1a69019d4699" status: 200 len: 1265 microversion: 2.1 time: 0.215181 Jun 23 11:54:06.982937 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 464/960] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:54:06 2022] GET /compute/v2.1/servers/6eefd0c5-c18b-435a-ac13-1a69019d4699 => generated 1265 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:54:07.530433 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-fdf1f740-f260-4aa3-ae7f-ba73a5fa5566 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:07.531060 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-fdf1f740-f260-4aa3-ae7f-ba73a5fa5566 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:07.539492 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-fdf1f740-f260-4aa3-ae7f-ba73a5fa5566 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:07.540283 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-fdf1f740-f260-4aa3-ae7f-ba73a5fa5566 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:07.541125 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-fdf1f740-f260-4aa3-ae7f-ba73a5fa5566 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:07.541644 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-fdf1f740-f260-4aa3-ae7f-ba73a5fa5566 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:07.690790 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-fdf1f740-f260-4aa3-ae7f-ba73a5fa5566 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:07.701304 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-fdf1f740-f260-4aa3-ae7f-ba73a5fa5566 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:07.703462 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-fdf1f740-f260-4aa3-ae7f-ba73a5fa5566 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:07.704812 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-fdf1f740-f260-4aa3-ae7f-ba73a5fa5566 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143" status: 200 len: 1725 microversion: 2.20 time: 0.178226 Jun 23 11:54:07.705409 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 497/961] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:54:07 2022] GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 => generated 1725 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:54:07.999462 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-0cf23d85-81db-4672-9758-742c4019c1bf tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:08.000094 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-0cf23d85-81db-4672-9758-742c4019c1bf tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] [instance: 6eefd0c5-c18b-435a-ac13-1a69019d4699] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:08.008363 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-0cf23d85-81db-4672-9758-742c4019c1bf tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:08.009195 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-0cf23d85-81db-4672-9758-742c4019c1bf tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:08.010088 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-0cf23d85-81db-4672-9758-742c4019c1bf tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:08.010738 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-0cf23d85-81db-4672-9758-742c4019c1bf tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:08.165086 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-0cf23d85-81db-4672-9758-742c4019c1bf tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc5a4676f6a416cbdc8c67ebd80cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e810a9bc3b44c4aa8ca2ddd0fa68f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:08.172693 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-0cf23d85-81db-4672-9758-742c4019c1bf tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] 10.222.0.13 "GET /compute/v2.1/servers/6eefd0c5-c18b-435a-ac13-1a69019d4699" status: 200 len: 1265 microversion: 2.1 time: 0.177365 Jun 23 11:54:08.173254 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 465/962] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:54:07 2022] GET /compute/v2.1/servers/6eefd0c5-c18b-435a-ac13-1a69019d4699 => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:54:08.724478 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-565fb7df-7ad5-42b6-8117-8fdbca9de667 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:08.725260 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-565fb7df-7ad5-42b6-8117-8fdbca9de667 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:08.732180 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-565fb7df-7ad5-42b6-8117-8fdbca9de667 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:08.732892 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-565fb7df-7ad5-42b6-8117-8fdbca9de667 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:08.733645 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-565fb7df-7ad5-42b6-8117-8fdbca9de667 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:08.734072 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-565fb7df-7ad5-42b6-8117-8fdbca9de667 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:08.896841 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-565fb7df-7ad5-42b6-8117-8fdbca9de667 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:08.905738 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-565fb7df-7ad5-42b6-8117-8fdbca9de667 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:08.907350 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-565fb7df-7ad5-42b6-8117-8fdbca9de667 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:08.908864 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-565fb7df-7ad5-42b6-8117-8fdbca9de667 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143" status: 200 len: 1725 microversion: 2.20 time: 0.189393 Jun 23 11:54:08.919912 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 498/963] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:54:08 2022] GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 => generated 1725 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:54:09.191028 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-d34a7d90-4c7b-4033-97aa-738b06179d18 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:09.191592 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-d34a7d90-4c7b-4033-97aa-738b06179d18 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] [instance: 6eefd0c5-c18b-435a-ac13-1a69019d4699] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:09.199288 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-d34a7d90-4c7b-4033-97aa-738b06179d18 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:09.200087 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-d34a7d90-4c7b-4033-97aa-738b06179d18 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:09.201078 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-d34a7d90-4c7b-4033-97aa-738b06179d18 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:09.201735 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-d34a7d90-4c7b-4033-97aa-738b06179d18 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:09.350989 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-d34a7d90-4c7b-4033-97aa-738b06179d18 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc5a4676f6a416cbdc8c67ebd80cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e810a9bc3b44c4aa8ca2ddd0fa68f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:09.359675 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-d34a7d90-4c7b-4033-97aa-738b06179d18 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] 10.222.0.13 "GET /compute/v2.1/servers/6eefd0c5-c18b-435a-ac13-1a69019d4699" status: 200 len: 1265 microversion: 2.1 time: 0.173867 Jun 23 11:54:09.366595 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 466/964] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:54:09 2022] GET /compute/v2.1/servers/6eefd0c5-c18b-435a-ac13-1a69019d4699 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:54:09.927088 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-fa42f234-6059-4b74-9dbc-2e24919c432d tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:09.927694 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-fa42f234-6059-4b74-9dbc-2e24919c432d tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:09.935724 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-fa42f234-6059-4b74-9dbc-2e24919c432d tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:09.936589 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-fa42f234-6059-4b74-9dbc-2e24919c432d tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:09.937567 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-fa42f234-6059-4b74-9dbc-2e24919c432d tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:09.938001 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-fa42f234-6059-4b74-9dbc-2e24919c432d tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:10.089860 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-fa42f234-6059-4b74-9dbc-2e24919c432d tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:10.098948 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-fa42f234-6059-4b74-9dbc-2e24919c432d tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:10.100509 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-fa42f234-6059-4b74-9dbc-2e24919c432d tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:10.102101 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-fa42f234-6059-4b74-9dbc-2e24919c432d tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143" status: 200 len: 1725 microversion: 2.20 time: 0.179022 Jun 23 11:54:10.103423 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 499/965] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:54:09 2022] GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 => generated 1725 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:54:10.380211 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-1e710012-66c2-470e-89a6-9aa6fbc1b44f tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:10.381456 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-1e710012-66c2-470e-89a6-9aa6fbc1b44f tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] [instance: 6eefd0c5-c18b-435a-ac13-1a69019d4699] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:10.388380 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-1e710012-66c2-470e-89a6-9aa6fbc1b44f tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:10.389068 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-1e710012-66c2-470e-89a6-9aa6fbc1b44f tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:10.390162 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-1e710012-66c2-470e-89a6-9aa6fbc1b44f tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:10.390787 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-1e710012-66c2-470e-89a6-9aa6fbc1b44f tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:10.551659 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-1e710012-66c2-470e-89a6-9aa6fbc1b44f tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc5a4676f6a416cbdc8c67ebd80cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e810a9bc3b44c4aa8ca2ddd0fa68f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:10.564314 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-1e710012-66c2-470e-89a6-9aa6fbc1b44f tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] 10.222.0.13 "GET /compute/v2.1/servers/6eefd0c5-c18b-435a-ac13-1a69019d4699" status: 200 len: 1265 microversion: 2.1 time: 0.185048 Jun 23 11:54:10.564917 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 467/966] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:54:10 2022] GET /compute/v2.1/servers/6eefd0c5-c18b-435a-ac13-1a69019d4699 => generated 1265 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:54:10.631335 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [req-4825da7e-6c0b-49ab-845b-853188ea757d req-1d3e63de-e8b2-4a88-81a2-ebe836bc1d23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6eefd0c5-c18b-435a-ac13-1a69019d4699", "name": "network-vif-plugged", "status": "completed", "tag": "2de3e3ea-22ec-4a86-899e-8c17d01954c3"}]} {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:54:10.640275 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-4825da7e-6c0b-49ab-845b-853188ea757d req-1d3e63de-e8b2-4a88-81a2-ebe836bc1d23 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:10.641126 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-4825da7e-6c0b-49ab-845b-853188ea757d req-1d3e63de-e8b2-4a88-81a2-ebe836bc1d23 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:10.654664 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.compute.server_external_events [req-4825da7e-6c0b-49ab-845b-853188ea757d req-1d3e63de-e8b2-4a88-81a2-ebe836bc1d23 service nova] Creating event network-vif-plugged:2de3e3ea-22ec-4a86-899e-8c17d01954c3 for instance 6eefd0c5-c18b-435a-ac13-1a69019d4699 on hv-cinder-82099 Jun 23 11:54:10.661305 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [req-4825da7e-6c0b-49ab-845b-853188ea757d req-1d3e63de-e8b2-4a88-81a2-ebe836bc1d23 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033644 Jun 23 11:54:10.662602 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 500/967] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:54:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:54:11.120493 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-8547686a-43d8-4f06-a4d7-1ca9596bce87 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:11.121228 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-8547686a-43d8-4f06-a4d7-1ca9596bce87 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:11.127567 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-8547686a-43d8-4f06-a4d7-1ca9596bce87 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:11.128113 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-8547686a-43d8-4f06-a4d7-1ca9596bce87 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:11.128982 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-8547686a-43d8-4f06-a4d7-1ca9596bce87 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:11.129427 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-8547686a-43d8-4f06-a4d7-1ca9596bce87 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:11.272541 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-8547686a-43d8-4f06-a4d7-1ca9596bce87 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:11.281942 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-8547686a-43d8-4f06-a4d7-1ca9596bce87 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:11.283182 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-8547686a-43d8-4f06-a4d7-1ca9596bce87 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:11.284998 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-8547686a-43d8-4f06-a4d7-1ca9596bce87 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143" status: 200 len: 1725 microversion: 2.20 time: 0.168168 Jun 23 11:54:11.285720 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 468/968] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:54:11 2022] GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:54:11.585232 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-00bd5911-697a-4b1e-be14-368f615685ff tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:11.585932 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-00bd5911-697a-4b1e-be14-368f615685ff tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] [instance: 6eefd0c5-c18b-435a-ac13-1a69019d4699] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:11.592138 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-00bd5911-697a-4b1e-be14-368f615685ff tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:11.592587 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-00bd5911-697a-4b1e-be14-368f615685ff tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:11.593342 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-00bd5911-697a-4b1e-be14-368f615685ff tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:11.593786 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-00bd5911-697a-4b1e-be14-368f615685ff tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:11.736104 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-00bd5911-697a-4b1e-be14-368f615685ff tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc5a4676f6a416cbdc8c67ebd80cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e810a9bc3b44c4aa8ca2ddd0fa68f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:11.744567 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-00bd5911-697a-4b1e-be14-368f615685ff tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] 10.222.0.13 "GET /compute/v2.1/servers/6eefd0c5-c18b-435a-ac13-1a69019d4699" status: 200 len: 1265 microversion: 2.1 time: 0.167019 Jun 23 11:54:11.745126 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 501/969] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:54:11 2022] GET /compute/v2.1/servers/6eefd0c5-c18b-435a-ac13-1a69019d4699 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:54:12.304718 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-a361711a-aadb-4e03-b82a-01e92a42a35e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:12.305329 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-a361711a-aadb-4e03-b82a-01e92a42a35e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:12.312123 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-a361711a-aadb-4e03-b82a-01e92a42a35e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:12.312609 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-a361711a-aadb-4e03-b82a-01e92a42a35e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:12.313398 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-a361711a-aadb-4e03-b82a-01e92a42a35e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:12.313839 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-a361711a-aadb-4e03-b82a-01e92a42a35e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:12.333615 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:54:12.444607 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-a361711a-aadb-4e03-b82a-01e92a42a35e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:12.452743 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-a361711a-aadb-4e03-b82a-01e92a42a35e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:12.454261 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-a361711a-aadb-4e03-b82a-01e92a42a35e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:12.455445 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-a361711a-aadb-4e03-b82a-01e92a42a35e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143" status: 200 len: 1725 microversion: 2.20 time: 0.155177 Jun 23 11:54:12.456771 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 469/970] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:54:12 2022] GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:54:12.713246 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-2af61a19-03aa-4022-918c-fa3a5bec1f0f tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Action: 'create', calling method: .version_select at 0x7f5d06674160>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-264066732", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAFOUwzfj7+49dY0JjB+XRO90/ZQ2cvSw0JnIfLUy+du2RliVt4ZB078E0Ykm8/52iND4eMebOnfsEZHFutlC5Q7sDwGhoza3xMll8ldGEo7FnCrpo4nD6bnDGb6C7iCEA=="}} {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:54:12.727843 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.quota [None req-2af61a19-03aa-4022-918c-fa3a5bec1f0f tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Getting quotas for project 17a1542e108d4e3e85fe5525a7e331d0. Resources: {'key_pairs'} {{(pid=124670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:54:12.731592 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.quota [None req-2af61a19-03aa-4022-918c-fa3a5bec1f0f tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Getting quotas for user 15a4c8e15cd44904805c2519c4b6864a and project 17a1542e108d4e3e85fe5525a7e331d0. Resources: {'key_pairs'} {{(pid=124670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:54:12.761177 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-73f9cb9b-1d5e-491c-af03-e5818ec73d9e tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:12.761781 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-73f9cb9b-1d5e-491c-af03-e5818ec73d9e tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] [instance: 6eefd0c5-c18b-435a-ac13-1a69019d4699] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:12.767780 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-73f9cb9b-1d5e-491c-af03-e5818ec73d9e tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:12.768234 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-73f9cb9b-1d5e-491c-af03-e5818ec73d9e tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:12.769395 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-73f9cb9b-1d5e-491c-af03-e5818ec73d9e tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:12.769833 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-73f9cb9b-1d5e-491c-af03-e5818ec73d9e tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:12.787455 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-2af61a19-03aa-4022-918c-fa3a5bec1f0f tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.078009 Jun 23 11:54:12.788194 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 502/971] 10.222.0.13 () {60 vars in 1158 bytes} [Thu Jun 23 11:54:12 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:54:12.837445 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-6e61e544-792c-4101-8f4a-f58c3a9c889e tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1658173000", "imageRef": "280aaf22-2d0b-41a8-8b58-15d1961d75f6", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-264066732", "networks": [{"uuid": "060de2a8-1f59-4640-9c37-62c65b265f51"}]}} {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:54:12.888038 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.network.neutron [None req-6e61e544-792c-4101-8f4a-f58c3a9c889e tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] validate_networks() for [('060de2a8-1f59-4640-9c37-62c65b265f51', None, None, None, None, None)] {{(pid=124670) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 11:54:12.912915 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-73f9cb9b-1d5e-491c-af03-e5818ec73d9e tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc5a4676f6a416cbdc8c67ebd80cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e810a9bc3b44c4aa8ca2ddd0fa68f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:12.920520 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-73f9cb9b-1d5e-491c-af03-e5818ec73d9e tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] 10.222.0.13 "GET /compute/v2.1/servers/6eefd0c5-c18b-435a-ac13-1a69019d4699" status: 200 len: 1265 microversion: 2.1 time: 0.163172 Jun 23 11:54:12.921087 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 470/972] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:54:12 2022] GET /compute/v2.1/servers/6eefd0c5-c18b-435a-ac13-1a69019d4699 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:54:13.263644 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.virt.hardware [None req-6e61e544-792c-4101-8f4a-f58c3a9c889e tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Flavor limits 0:0:0 {{(pid=124670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 11:54:13.264062 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.virt.hardware [None req-6e61e544-792c-4101-8f4a-f58c3a9c889e tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Image limits 0:0:0 {{(pid=124670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 11:54:13.264528 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.virt.hardware [None req-6e61e544-792c-4101-8f4a-f58c3a9c889e tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Flavor pref 0:0:0 {{(pid=124670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 11:54:13.264929 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.virt.hardware [None req-6e61e544-792c-4101-8f4a-f58c3a9c889e tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Image pref 0:0:0 {{(pid=124670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 11:54:13.265331 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.virt.hardware [None req-6e61e544-792c-4101-8f4a-f58c3a9c889e tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 11:54:13.274596 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-6e61e544-792c-4101-8f4a-f58c3a9c889e tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:13.275042 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-6e61e544-792c-4101-8f4a-f58c3a9c889e tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:13.275824 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-6e61e544-792c-4101-8f4a-f58c3a9c889e tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:13.276254 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-6e61e544-792c-4101-8f4a-f58c3a9c889e tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:13.293104 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.quota [None req-6e61e544-792c-4101-8f4a-f58c3a9c889e tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Getting quotas for project 17a1542e108d4e3e85fe5525a7e331d0. Resources: {'cores', 'instances', 'ram'} {{(pid=124670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:54:13.297031 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.quota [None req-6e61e544-792c-4101-8f4a-f58c3a9c889e tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Getting quotas for user 15a4c8e15cd44904805c2519c4b6864a and project 17a1542e108d4e3e85fe5525a7e331d0. Resources: {'cores', 'instances', 'ram'} {{(pid=124670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:54:13.309144 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-6e61e544-792c-4101-8f4a-f58c3a9c889e tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Going to run 1 instances... {{(pid=124670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 11:54:13.311346 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-6e61e544-792c-4101-8f4a-f58c3a9c889e tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] [instance: 06c1d69d-fafe-412e-ac84-49c12c6029d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='280aaf22-2d0b-41a8-8b58-15d1961d75f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 11:54:13.391130 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6e61e544-792c-4101-8f4a-f58c3a9c889e tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] [8fe85c2e-a21a-4f56-981d-4666801ff32f] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 23 11:54:13.474107 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-831f286b-d2d7-4e2c-82a9-325ca33b0e83 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:13.474776 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-831f286b-d2d7-4e2c-82a9-325ca33b0e83 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:13.481497 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-831f286b-d2d7-4e2c-82a9-325ca33b0e83 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:13.482022 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-831f286b-d2d7-4e2c-82a9-325ca33b0e83 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:13.482735 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-831f286b-d2d7-4e2c-82a9-325ca33b0e83 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:13.483173 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-831f286b-d2d7-4e2c-82a9-325ca33b0e83 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:13.612318 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-831f286b-d2d7-4e2c-82a9-325ca33b0e83 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:13.620586 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-831f286b-d2d7-4e2c-82a9-325ca33b0e83 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:13.622093 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-831f286b-d2d7-4e2c-82a9-325ca33b0e83 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:13.623290 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-831f286b-d2d7-4e2c-82a9-325ca33b0e83 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143" status: 200 len: 1725 microversion: 2.20 time: 0.153791 Jun 23 11:54:13.623873 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 471/973] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:54:13 2022] GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:54:13.936799 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-f29edf82-26ce-467c-9ff6-eb028c248aea tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:13.937409 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-f29edf82-26ce-467c-9ff6-eb028c248aea tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] [instance: 6eefd0c5-c18b-435a-ac13-1a69019d4699] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:13.944386 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-f29edf82-26ce-467c-9ff6-eb028c248aea tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:13.944832 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-f29edf82-26ce-467c-9ff6-eb028c248aea tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:13.945586 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-f29edf82-26ce-467c-9ff6-eb028c248aea tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:13.946018 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-f29edf82-26ce-467c-9ff6-eb028c248aea tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:14.079263 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-f29edf82-26ce-467c-9ff6-eb028c248aea tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc5a4676f6a416cbdc8c67ebd80cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e810a9bc3b44c4aa8ca2ddd0fa68f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:14.087484 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-f29edf82-26ce-467c-9ff6-eb028c248aea tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] 10.222.0.13 "GET /compute/v2.1/servers/6eefd0c5-c18b-435a-ac13-1a69019d4699" status: 200 len: 1451 microversion: 2.1 time: 0.154401 Jun 23 11:54:14.088043 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 472/974] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:54:13 2022] GET /compute/v2.1/servers/6eefd0c5-c18b-435a-ac13-1a69019d4699 => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:54:14.103612 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-358d6f37-8eaa-4fdb-a8f2-b8e83ac43550 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:14.104218 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-358d6f37-8eaa-4fdb-a8f2-b8e83ac43550 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] [instance: 6eefd0c5-c18b-435a-ac13-1a69019d4699] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:14.110243 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-358d6f37-8eaa-4fdb-a8f2-b8e83ac43550 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:14.110734 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-358d6f37-8eaa-4fdb-a8f2-b8e83ac43550 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:14.111611 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-358d6f37-8eaa-4fdb-a8f2-b8e83ac43550 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:14.112087 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-358d6f37-8eaa-4fdb-a8f2-b8e83ac43550 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:14.240916 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-358d6f37-8eaa-4fdb-a8f2-b8e83ac43550 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc5a4676f6a416cbdc8c67ebd80cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e810a9bc3b44c4aa8ca2ddd0fa68f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:14.248350 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-358d6f37-8eaa-4fdb-a8f2-b8e83ac43550 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] 10.222.0.13 "GET /compute/v2.1/servers/6eefd0c5-c18b-435a-ac13-1a69019d4699" status: 200 len: 1451 microversion: 2.1 time: 0.148705 Jun 23 11:54:14.248908 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 473/975] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:54:14 2022] GET /compute/v2.1/servers/6eefd0c5-c18b-435a-ac13-1a69019d4699 => generated 1451 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:54:14.398875 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO oslo.messaging._drivers.impl_rabbit [None req-6e61e544-792c-4101-8f4a-f58c3a9c889e tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] [8fe85c2e-a21a-4f56-981d-4666801ff32f] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 43658. Jun 23 11:54:14.403206 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-6e61e544-792c-4101-8f4a-f58c3a9c889e tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.569599 Jun 23 11:54:14.404128 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 503/976] 10.222.0.13 () {60 vars in 1146 bytes} [Thu Jun 23 11:54:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1571 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 23 11:54:14.418318 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-e3b2148e-ca1d-4237-9555-7cae6866742a tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:14.419863 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-e3b2148e-ca1d-4237-9555-7cae6866742a tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] [instance: 06c1d69d-fafe-412e-ac84-49c12c6029d0] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:14.475048 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-e3b2148e-ca1d-4237-9555-7cae6866742a tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a4c8e15cd44904805c2519c4b6864a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a1542e108d4e3e85fe5525a7e331d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:14.482121 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-e3b2148e-ca1d-4237-9555-7cae6866742a tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] 10.222.0.13 "GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0" status: 200 len: 1258 microversion: 2.1 time: 0.071148 Jun 23 11:54:14.482930 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 474/977] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:54:14 2022] GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0 => generated 1258 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:54:14.641390 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-c3a72aaf-2599-40d2-8e17-fb74cecc5303 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:14.641991 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-c3a72aaf-2599-40d2-8e17-fb74cecc5303 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:14.649037 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-c3a72aaf-2599-40d2-8e17-fb74cecc5303 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:14.649472 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-c3a72aaf-2599-40d2-8e17-fb74cecc5303 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:14.650306 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-c3a72aaf-2599-40d2-8e17-fb74cecc5303 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:14.650847 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-c3a72aaf-2599-40d2-8e17-fb74cecc5303 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:14.860498 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-c3a72aaf-2599-40d2-8e17-fb74cecc5303 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:14.872292 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-c3a72aaf-2599-40d2-8e17-fb74cecc5303 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:14.874076 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-c3a72aaf-2599-40d2-8e17-fb74cecc5303 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:14.875284 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-c3a72aaf-2599-40d2-8e17-fb74cecc5303 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143" status: 200 len: 1725 microversion: 2.20 time: 0.237841 Jun 23 11:54:14.875815 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 504/978] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:54:14 2022] GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 => generated 1725 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:54:15.499860 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-efcd12b4-7c9b-46f0-8e7d-66b113fcc23e tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:15.500478 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-efcd12b4-7c9b-46f0-8e7d-66b113fcc23e tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] [instance: 06c1d69d-fafe-412e-ac84-49c12c6029d0] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:15.508722 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-efcd12b4-7c9b-46f0-8e7d-66b113fcc23e tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:15.509181 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-efcd12b4-7c9b-46f0-8e7d-66b113fcc23e tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:15.509957 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-efcd12b4-7c9b-46f0-8e7d-66b113fcc23e tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:15.510396 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-efcd12b4-7c9b-46f0-8e7d-66b113fcc23e tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:15.594942 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-efcd12b4-7c9b-46f0-8e7d-66b113fcc23e tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a4c8e15cd44904805c2519c4b6864a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a1542e108d4e3e85fe5525a7e331d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:15.602663 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-efcd12b4-7c9b-46f0-8e7d-66b113fcc23e tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] 10.222.0.13 "GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0" status: 200 len: 1262 microversion: 2.1 time: 0.106697 Jun 23 11:54:15.603572 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 475/979] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:54:15 2022] GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0 => generated 1262 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:54:15.894367 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-fa799697-7ace-4b36-b85f-78dbeb8ba319 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:15.895275 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-fa799697-7ace-4b36-b85f-78dbeb8ba319 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:15.902200 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-fa799697-7ace-4b36-b85f-78dbeb8ba319 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:15.907954 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-fa799697-7ace-4b36-b85f-78dbeb8ba319 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:15.907954 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-fa799697-7ace-4b36-b85f-78dbeb8ba319 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:15.907954 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-fa799697-7ace-4b36-b85f-78dbeb8ba319 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:16.151068 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-fa799697-7ace-4b36-b85f-78dbeb8ba319 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:16.158895 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-fa799697-7ace-4b36-b85f-78dbeb8ba319 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:16.160969 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-fa799697-7ace-4b36-b85f-78dbeb8ba319 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:16.162163 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-fa799697-7ace-4b36-b85f-78dbeb8ba319 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143" status: 200 len: 1746 microversion: 2.20 time: 0.271685 Jun 23 11:54:16.162745 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 505/980] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:54:15 2022] GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 => generated 1746 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:54:16.477320 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [req-77188a9a-8558-455a-af2d-312d1585a776 req-472ce844-b41b-4d49-9d14-0d48e6c82f99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6eefd0c5-c18b-435a-ac13-1a69019d4699", "tag": "2de3e3ea-22ec-4a86-899e-8c17d01954c3"}]} {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:54:16.487619 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [req-77188a9a-8558-455a-af2d-312d1585a776 req-472ce844-b41b-4d49-9d14-0d48e6c82f99 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:16.487619 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [req-77188a9a-8558-455a-af2d-312d1585a776 req-472ce844-b41b-4d49-9d14-0d48e6c82f99 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:16.500221 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.compute.server_external_events [req-77188a9a-8558-455a-af2d-312d1585a776 req-472ce844-b41b-4d49-9d14-0d48e6c82f99 service nova] Creating event network-changed:2de3e3ea-22ec-4a86-899e-8c17d01954c3 for instance 6eefd0c5-c18b-435a-ac13-1a69019d4699 on hv-cinder-82099 Jun 23 11:54:16.505753 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [req-77188a9a-8558-455a-af2d-312d1585a776 req-472ce844-b41b-4d49-9d14-0d48e6c82f99 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033903 Jun 23 11:54:16.506815 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 476/981] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:54:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:54:16.621378 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-8ad6f611-157c-412f-a564-4310ee3340a0 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:16.621992 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-8ad6f611-157c-412f-a564-4310ee3340a0 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] [instance: 06c1d69d-fafe-412e-ac84-49c12c6029d0] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:16.630868 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-8ad6f611-157c-412f-a564-4310ee3340a0 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:16.636100 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-8ad6f611-157c-412f-a564-4310ee3340a0 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:16.636100 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-8ad6f611-157c-412f-a564-4310ee3340a0 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:16.636100 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-8ad6f611-157c-412f-a564-4310ee3340a0 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:16.678242 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_cell1:SELECT=100 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:54:16.759809 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-8ad6f611-157c-412f-a564-4310ee3340a0 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a4c8e15cd44904805c2519c4b6864a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a1542e108d4e3e85fe5525a7e331d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:16.770206 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-8ad6f611-157c-412f-a564-4310ee3340a0 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] 10.222.0.13 "GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0" status: 200 len: 1318 microversion: 2.1 time: 0.153516 Jun 23 11:54:16.771782 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 506/982] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:54:16 2022] GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:54:17.182084 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-ac5f8c06-a075-4cb0-9457-32ade8f91f44 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:17.182916 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-ac5f8c06-a075-4cb0-9457-32ade8f91f44 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:17.191473 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ac5f8c06-a075-4cb0-9457-32ade8f91f44 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:17.192203 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ac5f8c06-a075-4cb0-9457-32ade8f91f44 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:17.198695 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ac5f8c06-a075-4cb0-9457-32ade8f91f44 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:17.198695 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ac5f8c06-a075-4cb0-9457-32ade8f91f44 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:17.448973 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-ac5f8c06-a075-4cb0-9457-32ade8f91f44 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:17.458884 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-ac5f8c06-a075-4cb0-9457-32ade8f91f44 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:17.467082 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-ac5f8c06-a075-4cb0-9457-32ade8f91f44 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:17.469077 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-ac5f8c06-a075-4cb0-9457-32ade8f91f44 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143" status: 200 len: 1746 microversion: 2.20 time: 0.291311 Jun 23 11:54:17.472888 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 477/983] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:54:17 2022] GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 => generated 1746 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:54:17.789871 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-e02c1167-eb7b-49fe-b847-e917a792b383 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:17.791017 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-e02c1167-eb7b-49fe-b847-e917a792b383 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] [instance: 06c1d69d-fafe-412e-ac84-49c12c6029d0] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:17.809455 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-e02c1167-eb7b-49fe-b847-e917a792b383 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:17.810184 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-e02c1167-eb7b-49fe-b847-e917a792b383 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:17.811168 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-e02c1167-eb7b-49fe-b847-e917a792b383 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:17.811755 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-e02c1167-eb7b-49fe-b847-e917a792b383 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:18.055756 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-e02c1167-eb7b-49fe-b847-e917a792b383 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a4c8e15cd44904805c2519c4b6864a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a1542e108d4e3e85fe5525a7e331d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:18.076014 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-e02c1167-eb7b-49fe-b847-e917a792b383 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] 10.222.0.13 "GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0" status: 200 len: 1358 microversion: 2.1 time: 0.292101 Jun 23 11:54:18.086593 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 507/984] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:54:17 2022] GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0 => generated 1358 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:54:18.489918 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-af5ee5ee-e5e5-4a42-9f46-8f97cfe71fc1 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:18.490680 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-af5ee5ee-e5e5-4a42-9f46-8f97cfe71fc1 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:18.497482 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-af5ee5ee-e5e5-4a42-9f46-8f97cfe71fc1 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:18.498045 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-af5ee5ee-e5e5-4a42-9f46-8f97cfe71fc1 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:18.499042 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-af5ee5ee-e5e5-4a42-9f46-8f97cfe71fc1 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:18.499642 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-af5ee5ee-e5e5-4a42-9f46-8f97cfe71fc1 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:18.582359 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [req-1be4054d-f10b-4533-b8a0-a9f0ced3c4a3 req-b7baf487-acf2-4e56-88d1-83d5faced88c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e51258d-c99d-4d15-8463-c699bcfa9143", "name": "network-vif-plugged", "status": "completed", "tag": "2fc09618-5ffd-4c12-8072-c756814d925d"}]} {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:54:18.593741 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-1be4054d-f10b-4533-b8a0-a9f0ced3c4a3 req-b7baf487-acf2-4e56-88d1-83d5faced88c service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:18.594370 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-1be4054d-f10b-4533-b8a0-a9f0ced3c4a3 req-b7baf487-acf2-4e56-88d1-83d5faced88c service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:18.607142 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.compute.server_external_events [req-1be4054d-f10b-4533-b8a0-a9f0ced3c4a3 req-b7baf487-acf2-4e56-88d1-83d5faced88c service nova] Creating event network-vif-plugged:2fc09618-5ffd-4c12-8072-c756814d925d for instance 1e51258d-c99d-4d15-8463-c699bcfa9143 on hv-cinder-82099 Jun 23 11:54:18.612230 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [req-1be4054d-f10b-4533-b8a0-a9f0ced3c4a3 req-b7baf487-acf2-4e56-88d1-83d5faced88c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033576 Jun 23 11:54:18.613951 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 508/985] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:54:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:54:18.654817 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-af5ee5ee-e5e5-4a42-9f46-8f97cfe71fc1 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:18.666008 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-af5ee5ee-e5e5-4a42-9f46-8f97cfe71fc1 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:18.667757 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-af5ee5ee-e5e5-4a42-9f46-8f97cfe71fc1 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:18.669071 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-af5ee5ee-e5e5-4a42-9f46-8f97cfe71fc1 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143" status: 200 len: 1746 microversion: 2.20 time: 0.183738 Jun 23 11:54:18.669723 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 478/986] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:54:18 2022] GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 => generated 1746 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:54:19.101517 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-751f2a97-ec0f-4fae-83c5-30bf7ac112f4 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:19.102963 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-751f2a97-ec0f-4fae-83c5-30bf7ac112f4 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] [instance: 06c1d69d-fafe-412e-ac84-49c12c6029d0] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:19.109165 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-751f2a97-ec0f-4fae-83c5-30bf7ac112f4 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:19.109724 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-751f2a97-ec0f-4fae-83c5-30bf7ac112f4 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:19.110493 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-751f2a97-ec0f-4fae-83c5-30bf7ac112f4 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:19.110957 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-751f2a97-ec0f-4fae-83c5-30bf7ac112f4 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:19.253628 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-751f2a97-ec0f-4fae-83c5-30bf7ac112f4 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a4c8e15cd44904805c2519c4b6864a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a1542e108d4e3e85fe5525a7e331d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:19.261509 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-751f2a97-ec0f-4fae-83c5-30bf7ac112f4 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] 10.222.0.13 "GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0" status: 200 len: 1358 microversion: 2.1 time: 0.165529 Jun 23 11:54:19.262085 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 509/987] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:54:19 2022] GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:54:19.688008 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-31fa3148-0574-4e6e-b93a-9e41dce943d7 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:19.688734 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-31fa3148-0574-4e6e-b93a-9e41dce943d7 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:19.695876 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-31fa3148-0574-4e6e-b93a-9e41dce943d7 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:19.696327 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-31fa3148-0574-4e6e-b93a-9e41dce943d7 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:19.697099 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-31fa3148-0574-4e6e-b93a-9e41dce943d7 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:19.697534 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-31fa3148-0574-4e6e-b93a-9e41dce943d7 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:19.832295 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-31fa3148-0574-4e6e-b93a-9e41dce943d7 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:19.840241 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-31fa3148-0574-4e6e-b93a-9e41dce943d7 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:19.841751 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-31fa3148-0574-4e6e-b93a-9e41dce943d7 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:19.842942 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-31fa3148-0574-4e6e-b93a-9e41dce943d7 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143" status: 200 len: 1746 microversion: 2.20 time: 0.158886 Jun 23 11:54:19.843505 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 479/988] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:54:19 2022] GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 => generated 1746 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:54:20.278822 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-b850a52b-266e-440f-bc9a-74fa6fdb788e tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:20.280119 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-b850a52b-266e-440f-bc9a-74fa6fdb788e tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] [instance: 06c1d69d-fafe-412e-ac84-49c12c6029d0] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:20.287699 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-b850a52b-266e-440f-bc9a-74fa6fdb788e tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:20.288236 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-b850a52b-266e-440f-bc9a-74fa6fdb788e tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:20.289074 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-b850a52b-266e-440f-bc9a-74fa6fdb788e tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:20.289598 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-b850a52b-266e-440f-bc9a-74fa6fdb788e tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:20.418467 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-b850a52b-266e-440f-bc9a-74fa6fdb788e tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a4c8e15cd44904805c2519c4b6864a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a1542e108d4e3e85fe5525a7e331d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:20.427324 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-b850a52b-266e-440f-bc9a-74fa6fdb788e tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] 10.222.0.13 "GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0" status: 200 len: 1358 microversion: 2.1 time: 0.152214 Jun 23 11:54:20.432337 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 510/989] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:54:20 2022] GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:54:20.860579 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-51176668-3ff5-4684-b974-c0945dbb90d3 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:20.861208 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-51176668-3ff5-4684-b974-c0945dbb90d3 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:20.868790 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-51176668-3ff5-4684-b974-c0945dbb90d3 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:20.869245 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-51176668-3ff5-4684-b974-c0945dbb90d3 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:20.870006 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-51176668-3ff5-4684-b974-c0945dbb90d3 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:20.870429 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-51176668-3ff5-4684-b974-c0945dbb90d3 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:21.014936 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-51176668-3ff5-4684-b974-c0945dbb90d3 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:21.025761 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-51176668-3ff5-4684-b974-c0945dbb90d3 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:21.027657 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-51176668-3ff5-4684-b974-c0945dbb90d3 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:21.028980 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-51176668-3ff5-4684-b974-c0945dbb90d3 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143" status: 200 len: 1746 microversion: 2.20 time: 0.172324 Jun 23 11:54:21.029631 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 480/990] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:54:20 2022] GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 => generated 1746 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:54:21.443389 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-250af93f-fb3a-4dfc-842f-3be292772f07 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:21.444108 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-250af93f-fb3a-4dfc-842f-3be292772f07 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] [instance: 06c1d69d-fafe-412e-ac84-49c12c6029d0] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:21.450750 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-250af93f-fb3a-4dfc-842f-3be292772f07 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:21.451193 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-250af93f-fb3a-4dfc-842f-3be292772f07 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:21.452022 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-250af93f-fb3a-4dfc-842f-3be292772f07 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:21.452448 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-250af93f-fb3a-4dfc-842f-3be292772f07 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:21.589439 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-250af93f-fb3a-4dfc-842f-3be292772f07 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a4c8e15cd44904805c2519c4b6864a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a1542e108d4e3e85fe5525a7e331d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:21.597300 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-250af93f-fb3a-4dfc-842f-3be292772f07 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] 10.222.0.13 "GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0" status: 200 len: 1358 microversion: 2.1 time: 0.158001 Jun 23 11:54:21.597883 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 511/991] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:54:21 2022] GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:54:22.049538 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-a0d960e1-cd2e-4f81-9d64-74d6e2585e87 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:22.050150 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-a0d960e1-cd2e-4f81-9d64-74d6e2585e87 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:22.056965 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-a0d960e1-cd2e-4f81-9d64-74d6e2585e87 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:22.057417 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-a0d960e1-cd2e-4f81-9d64-74d6e2585e87 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:22.058172 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-a0d960e1-cd2e-4f81-9d64-74d6e2585e87 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:22.058636 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-a0d960e1-cd2e-4f81-9d64-74d6e2585e87 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:22.164955 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-ed8b3c9c-7451-4ada-8be0-e5a2e12129bf tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:22.165728 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-ed8b3c9c-7451-4ada-8be0-e5a2e12129bf tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: f0c76b74-bb63-4f9a-aede-52182140750b] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:22.172103 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-ed8b3c9c-7451-4ada-8be0-e5a2e12129bf tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:22.172817 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-ed8b3c9c-7451-4ada-8be0-e5a2e12129bf tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:22.173577 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-ed8b3c9c-7451-4ada-8be0-e5a2e12129bf tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:22.174168 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-ed8b3c9c-7451-4ada-8be0-e5a2e12129bf tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:22.199282 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-ed8b3c9c-7451-4ada-8be0-e5a2e12129bf tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/f0c76b74-bb63-4f9a-aede-52182140750b/ips" status: 200 len: 146 microversion: 2.1 time: 0.038190 Jun 23 11:54:22.200035 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 512/992] 10.222.0.13 () {58 vars in 1247 bytes} [Thu Jun 23 11:54:22 2022] GET /compute/v2.1/servers/f0c76b74-bb63-4f9a-aede-52182140750b/ips => generated 146 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:54:22.200860 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-a0d960e1-cd2e-4f81-9d64-74d6e2585e87 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:22.209356 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-a0d960e1-cd2e-4f81-9d64-74d6e2585e87 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:22.210899 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-a0d960e1-cd2e-4f81-9d64-74d6e2585e87 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:22.212075 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-a0d960e1-cd2e-4f81-9d64-74d6e2585e87 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143" status: 200 len: 1746 microversion: 2.20 time: 0.166582 Jun 23 11:54:22.212982 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 481/993] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:54:22 2022] GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 => generated 1746 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:54:22.616032 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-c565458d-701e-41ca-8807-b08b7a069520 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:22.617270 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-c565458d-701e-41ca-8807-b08b7a069520 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] [instance: 06c1d69d-fafe-412e-ac84-49c12c6029d0] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:22.625203 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-c565458d-701e-41ca-8807-b08b7a069520 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:22.625853 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-c565458d-701e-41ca-8807-b08b7a069520 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:22.626872 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-c565458d-701e-41ca-8807-b08b7a069520 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:22.627802 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-c565458d-701e-41ca-8807-b08b7a069520 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:22.771955 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-c565458d-701e-41ca-8807-b08b7a069520 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a4c8e15cd44904805c2519c4b6864a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a1542e108d4e3e85fe5525a7e331d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:22.779756 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-c565458d-701e-41ca-8807-b08b7a069520 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] 10.222.0.13 "GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0" status: 200 len: 1358 microversion: 2.1 time: 0.168303 Jun 23 11:54:22.783889 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 513/994] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:54:22 2022] GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:54:23.231521 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-558516bb-a889-4ce4-bad5-ae73e6300539 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:23.232130 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-558516bb-a889-4ce4-bad5-ae73e6300539 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:23.234680 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=3 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:54:23.240581 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-558516bb-a889-4ce4-bad5-ae73e6300539 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:23.241069 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-558516bb-a889-4ce4-bad5-ae73e6300539 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:23.242157 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-558516bb-a889-4ce4-bad5-ae73e6300539 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:23.242671 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-558516bb-a889-4ce4-bad5-ae73e6300539 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:23.393849 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-558516bb-a889-4ce4-bad5-ae73e6300539 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:23.401738 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-558516bb-a889-4ce4-bad5-ae73e6300539 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:23.403299 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-558516bb-a889-4ce4-bad5-ae73e6300539 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:23.404445 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-558516bb-a889-4ce4-bad5-ae73e6300539 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143" status: 200 len: 1746 microversion: 2.20 time: 0.177453 Jun 23 11:54:23.404996 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 482/995] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:54:23 2022] GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 => generated 1746 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:54:23.797248 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-ca45f6ea-d9e5-4c28-8722-afb315bc8215 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:23.797967 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-ca45f6ea-d9e5-4c28-8722-afb315bc8215 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] [instance: 06c1d69d-fafe-412e-ac84-49c12c6029d0] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:23.800071 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_cell0:SELECT=2 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:54:23.801046 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_cell0:SELECT=10 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:54:23.802506 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=4 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:54:23.807998 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-ca45f6ea-d9e5-4c28-8722-afb315bc8215 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:23.808451 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-ca45f6ea-d9e5-4c28-8722-afb315bc8215 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:23.809223 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-ca45f6ea-d9e5-4c28-8722-afb315bc8215 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:23.809654 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-ca45f6ea-d9e5-4c28-8722-afb315bc8215 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:23.950605 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-ca45f6ea-d9e5-4c28-8722-afb315bc8215 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a4c8e15cd44904805c2519c4b6864a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a1542e108d4e3e85fe5525a7e331d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:23.958935 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-ca45f6ea-d9e5-4c28-8722-afb315bc8215 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] 10.222.0.13 "GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0" status: 200 len: 1358 microversion: 2.1 time: 0.164865 Jun 23 11:54:23.959515 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 514/996] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:54:23 2022] GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:54:24.423239 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-327277ac-152e-435b-b791-f765cd4faa45 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:24.423843 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-327277ac-152e-435b-b791-f765cd4faa45 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:24.431745 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-327277ac-152e-435b-b791-f765cd4faa45 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:24.432191 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-327277ac-152e-435b-b791-f765cd4faa45 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:24.433192 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-327277ac-152e-435b-b791-f765cd4faa45 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:24.433625 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-327277ac-152e-435b-b791-f765cd4faa45 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:24.479891 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_cell0:SELECT=2 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:54:24.574146 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-327277ac-152e-435b-b791-f765cd4faa45 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:24.582383 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-327277ac-152e-435b-b791-f765cd4faa45 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:24.583942 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-327277ac-152e-435b-b791-f765cd4faa45 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:24.586079 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-327277ac-152e-435b-b791-f765cd4faa45 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143" status: 200 len: 1746 microversion: 2.20 time: 0.166750 Jun 23 11:54:24.586835 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 483/997] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:54:24 2022] GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 => generated 1746 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:54:24.814863 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-6beccf78-387c-40b9-9776-f509705dfc4c tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1fb2618e-d788-4fb1-96e2-6478a7bb4136"}} {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:54:24.816762 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-6beccf78-387c-40b9-9776-f509705dfc4c tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: f0c76b74-bb63-4f9a-aede-52182140750b] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:24.823879 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-6beccf78-387c-40b9-9776-f509705dfc4c tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:24.824667 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-6beccf78-387c-40b9-9776-f509705dfc4c tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:24.826008 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-6beccf78-387c-40b9-9776-f509705dfc4c tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:24.826690 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-6beccf78-387c-40b9-9776-f509705dfc4c tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:24.976897 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-6d576ead-cd4e-46b0-b5d9-9e6f78c9a36d tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:24.977772 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-6d576ead-cd4e-46b0-b5d9-9e6f78c9a36d tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] [instance: 06c1d69d-fafe-412e-ac84-49c12c6029d0] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:24.983756 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-6d576ead-cd4e-46b0-b5d9-9e6f78c9a36d tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:24.984201 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-6d576ead-cd4e-46b0-b5d9-9e6f78c9a36d tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:24.984947 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-6d576ead-cd4e-46b0-b5d9-9e6f78c9a36d tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:24.985382 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-6d576ead-cd4e-46b0-b5d9-9e6f78c9a36d tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:25.125220 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-6d576ead-cd4e-46b0-b5d9-9e6f78c9a36d tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a4c8e15cd44904805c2519c4b6864a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a1542e108d4e3e85fe5525a7e331d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:25.142972 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-6d576ead-cd4e-46b0-b5d9-9e6f78c9a36d tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] 10.222.0.13 "GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0" status: 200 len: 1358 microversion: 2.1 time: 0.170694 Jun 23 11:54:25.152548 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 484/998] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:54:24 2022] GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0 => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:54:25.605760 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-b732cd62-bbff-437d-ba9c-b73571b88119 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:25.606685 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-b732cd62-bbff-437d-ba9c-b73571b88119 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:25.613124 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-b732cd62-bbff-437d-ba9c-b73571b88119 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:25.613570 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-b732cd62-bbff-437d-ba9c-b73571b88119 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:25.614326 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-b732cd62-bbff-437d-ba9c-b73571b88119 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:25.614796 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-b732cd62-bbff-437d-ba9c-b73571b88119 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:25.759509 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-b732cd62-bbff-437d-ba9c-b73571b88119 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:25.767860 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-b732cd62-bbff-437d-ba9c-b73571b88119 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:25.788821 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-b732cd62-bbff-437d-ba9c-b73571b88119 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:25.788821 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-b732cd62-bbff-437d-ba9c-b73571b88119 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143" status: 200 len: 1746 microversion: 2.20 time: 0.169001 Jun 23 11:54:25.788821 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 485/999] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:54:25 2022] GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 => generated 1746 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:54:26.160037 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-cda3670f-aa58-4558-a77c-812128698f38 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:26.160572 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-cda3670f-aa58-4558-a77c-812128698f38 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] [instance: 06c1d69d-fafe-412e-ac84-49c12c6029d0] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:26.169978 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-cda3670f-aa58-4558-a77c-812128698f38 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:26.171387 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-cda3670f-aa58-4558-a77c-812128698f38 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:26.172582 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-cda3670f-aa58-4558-a77c-812128698f38 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:26.173193 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-cda3670f-aa58-4558-a77c-812128698f38 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:26.359103 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-cda3670f-aa58-4558-a77c-812128698f38 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a4c8e15cd44904805c2519c4b6864a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a1542e108d4e3e85fe5525a7e331d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:26.359103 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-cda3670f-aa58-4558-a77c-812128698f38 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] 10.222.0.13 "GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0" status: 200 len: 1358 microversion: 2.1 time: 0.157749 Jun 23 11:54:26.359103 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 486/1000] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:54:26 2022] GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:54:26.806096 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-d68600f6-cefc-43e7-a1e6-eececfe71ba7 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:26.806816 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-d68600f6-cefc-43e7-a1e6-eececfe71ba7 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:26.813342 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-d68600f6-cefc-43e7-a1e6-eececfe71ba7 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:26.813793 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-d68600f6-cefc-43e7-a1e6-eececfe71ba7 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:26.814578 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-d68600f6-cefc-43e7-a1e6-eececfe71ba7 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:26.815017 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-d68600f6-cefc-43e7-a1e6-eececfe71ba7 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:26.948787 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-d68600f6-cefc-43e7-a1e6-eececfe71ba7 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:26.952151 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_cell1:SELECT=100 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:54:26.956769 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-d68600f6-cefc-43e7-a1e6-eececfe71ba7 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:26.958263 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-d68600f6-cefc-43e7-a1e6-eececfe71ba7 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:26.960097 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-d68600f6-cefc-43e7-a1e6-eececfe71ba7 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143" status: 200 len: 1746 microversion: 2.20 time: 0.158288 Jun 23 11:54:26.960660 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 487/1001] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:54:26 2022] GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 => generated 1746 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:54:27.342315 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-a34df6df-c9f2-4d2f-b3bc-84948ddb7b0a tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:27.343073 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-a34df6df-c9f2-4d2f-b3bc-84948ddb7b0a tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] [instance: 06c1d69d-fafe-412e-ac84-49c12c6029d0] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:27.349535 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-a34df6df-c9f2-4d2f-b3bc-84948ddb7b0a tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:27.350704 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-a34df6df-c9f2-4d2f-b3bc-84948ddb7b0a tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:27.351468 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-a34df6df-c9f2-4d2f-b3bc-84948ddb7b0a tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:27.351904 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-a34df6df-c9f2-4d2f-b3bc-84948ddb7b0a tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:27.499507 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-a34df6df-c9f2-4d2f-b3bc-84948ddb7b0a tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a4c8e15cd44904805c2519c4b6864a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a1542e108d4e3e85fe5525a7e331d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:27.507628 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-a34df6df-c9f2-4d2f-b3bc-84948ddb7b0a tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] 10.222.0.13 "GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0" status: 200 len: 1358 microversion: 2.1 time: 0.169110 Jun 23 11:54:27.508192 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 488/1002] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:54:27 2022] GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:54:27.977938 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-4fef4c0b-cf9d-42bc-8bcc-36986040fb8e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:27.978648 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-4fef4c0b-cf9d-42bc-8bcc-36986040fb8e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:27.985053 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-4fef4c0b-cf9d-42bc-8bcc-36986040fb8e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:27.985507 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-4fef4c0b-cf9d-42bc-8bcc-36986040fb8e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:27.986267 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-4fef4c0b-cf9d-42bc-8bcc-36986040fb8e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:27.986736 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-4fef4c0b-cf9d-42bc-8bcc-36986040fb8e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:28.370263 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-4fef4c0b-cf9d-42bc-8bcc-36986040fb8e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:28.378580 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-4fef4c0b-cf9d-42bc-8bcc-36986040fb8e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:28.380086 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-4fef4c0b-cf9d-42bc-8bcc-36986040fb8e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:28.382060 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-4fef4c0b-cf9d-42bc-8bcc-36986040fb8e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143" status: 200 len: 1746 microversion: 2.20 time: 0.407631 Jun 23 11:54:28.392556 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 489/1003] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:54:27 2022] GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 => generated 1746 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:54:28.532389 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-f4ec5a38-07d2-4035-9e9e-4b70a6c60e7d tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:28.533085 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-f4ec5a38-07d2-4035-9e9e-4b70a6c60e7d tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] [instance: 06c1d69d-fafe-412e-ac84-49c12c6029d0] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:28.541465 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-f4ec5a38-07d2-4035-9e9e-4b70a6c60e7d tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:28.542208 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-f4ec5a38-07d2-4035-9e9e-4b70a6c60e7d tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:28.543191 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-f4ec5a38-07d2-4035-9e9e-4b70a6c60e7d tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:28.543858 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-f4ec5a38-07d2-4035-9e9e-4b70a6c60e7d tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:28.679612 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-f4ec5a38-07d2-4035-9e9e-4b70a6c60e7d tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a4c8e15cd44904805c2519c4b6864a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a1542e108d4e3e85fe5525a7e331d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:28.687918 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-f4ec5a38-07d2-4035-9e9e-4b70a6c60e7d tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] 10.222.0.13 "GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0" status: 200 len: 1358 microversion: 2.1 time: 0.163735 Jun 23 11:54:28.688621 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 490/1004] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:54:28 2022] GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:54:29.400666 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-998a5194-6fc5-495b-9d39-ff4d5282e075 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:29.401341 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-998a5194-6fc5-495b-9d39-ff4d5282e075 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:29.407730 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-998a5194-6fc5-495b-9d39-ff4d5282e075 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:29.408184 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-998a5194-6fc5-495b-9d39-ff4d5282e075 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:29.408945 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-998a5194-6fc5-495b-9d39-ff4d5282e075 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:29.409388 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-998a5194-6fc5-495b-9d39-ff4d5282e075 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:29.540103 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-998a5194-6fc5-495b-9d39-ff4d5282e075 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:29.548036 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-998a5194-6fc5-495b-9d39-ff4d5282e075 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:29.549537 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-998a5194-6fc5-495b-9d39-ff4d5282e075 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:29.550723 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-998a5194-6fc5-495b-9d39-ff4d5282e075 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143" status: 200 len: 1746 microversion: 2.20 time: 0.154421 Jun 23 11:54:29.551280 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 491/1005] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:54:29 2022] GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 => generated 1746 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:54:29.707007 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-8d270529-4744-48b6-8195-76fe4e28f68d tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:29.707540 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-8d270529-4744-48b6-8195-76fe4e28f68d tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] [instance: 06c1d69d-fafe-412e-ac84-49c12c6029d0] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:29.714194 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-8d270529-4744-48b6-8195-76fe4e28f68d tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:29.714717 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-8d270529-4744-48b6-8195-76fe4e28f68d tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:29.715524 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-8d270529-4744-48b6-8195-76fe4e28f68d tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:29.715955 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-8d270529-4744-48b6-8195-76fe4e28f68d tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:29.844861 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-8d270529-4744-48b6-8195-76fe4e28f68d tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a4c8e15cd44904805c2519c4b6864a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a1542e108d4e3e85fe5525a7e331d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:29.853139 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-8d270529-4744-48b6-8195-76fe4e28f68d tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] 10.222.0.13 "GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0" status: 200 len: 1358 microversion: 2.1 time: 0.150173 Jun 23 11:54:29.858138 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 492/1006] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:54:29 2022] GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:54:30.569946 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-5c6f13c4-4f4e-4bd0-9f6a-7dee04529cf7 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:30.570572 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-5c6f13c4-4f4e-4bd0-9f6a-7dee04529cf7 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:30.576927 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-5c6f13c4-4f4e-4bd0-9f6a-7dee04529cf7 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:30.577374 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-5c6f13c4-4f4e-4bd0-9f6a-7dee04529cf7 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:30.578126 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-5c6f13c4-4f4e-4bd0-9f6a-7dee04529cf7 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:30.578641 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-5c6f13c4-4f4e-4bd0-9f6a-7dee04529cf7 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:30.704932 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-5c6f13c4-4f4e-4bd0-9f6a-7dee04529cf7 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:30.713050 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-5c6f13c4-4f4e-4bd0-9f6a-7dee04529cf7 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:30.714578 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-5c6f13c4-4f4e-4bd0-9f6a-7dee04529cf7 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:30.715751 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-5c6f13c4-4f4e-4bd0-9f6a-7dee04529cf7 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143" status: 200 len: 1746 microversion: 2.20 time: 0.150625 Jun 23 11:54:30.716307 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 493/1007] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:54:30 2022] GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 => generated 1746 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:54:30.869517 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-a97af2b7-b05c-4192-afbc-dc0f8ae5a5c9 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:30.870123 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-a97af2b7-b05c-4192-afbc-dc0f8ae5a5c9 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] [instance: 06c1d69d-fafe-412e-ac84-49c12c6029d0] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:30.876082 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-a97af2b7-b05c-4192-afbc-dc0f8ae5a5c9 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:30.876527 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-a97af2b7-b05c-4192-afbc-dc0f8ae5a5c9 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:30.877280 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-a97af2b7-b05c-4192-afbc-dc0f8ae5a5c9 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:30.877706 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-a97af2b7-b05c-4192-afbc-dc0f8ae5a5c9 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:31.004578 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-a97af2b7-b05c-4192-afbc-dc0f8ae5a5c9 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a4c8e15cd44904805c2519c4b6864a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a1542e108d4e3e85fe5525a7e331d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:31.012451 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-a97af2b7-b05c-4192-afbc-dc0f8ae5a5c9 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] 10.222.0.13 "GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0" status: 200 len: 1358 microversion: 2.1 time: 0.146719 Jun 23 11:54:31.013018 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 494/1008] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:54:30 2022] GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0 => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:54:31.733450 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-b0846118-f284-49a5-be95-fbd8aac43fe8 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:31.734117 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-b0846118-f284-49a5-be95-fbd8aac43fe8 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:31.741390 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-b0846118-f284-49a5-be95-fbd8aac43fe8 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:31.741832 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-b0846118-f284-49a5-be95-fbd8aac43fe8 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:31.742621 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-b0846118-f284-49a5-be95-fbd8aac43fe8 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:31.743052 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-b0846118-f284-49a5-be95-fbd8aac43fe8 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:31.874636 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-b0846118-f284-49a5-be95-fbd8aac43fe8 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:31.883035 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-b0846118-f284-49a5-be95-fbd8aac43fe8 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:31.884532 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-b0846118-f284-49a5-be95-fbd8aac43fe8 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:31.885696 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-b0846118-f284-49a5-be95-fbd8aac43fe8 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143" status: 200 len: 1746 microversion: 2.20 time: 0.156109 Jun 23 11:54:31.886254 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 495/1009] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:54:31 2022] GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 => generated 1746 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:54:32.028724 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-c98cbefd-43c1-49b8-b1c1-3a61dbf779dc tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:32.029259 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-c98cbefd-43c1-49b8-b1c1-3a61dbf779dc tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] [instance: 06c1d69d-fafe-412e-ac84-49c12c6029d0] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:32.035320 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c98cbefd-43c1-49b8-b1c1-3a61dbf779dc tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:32.035767 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c98cbefd-43c1-49b8-b1c1-3a61dbf779dc tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:32.036519 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c98cbefd-43c1-49b8-b1c1-3a61dbf779dc tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:32.037015 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c98cbefd-43c1-49b8-b1c1-3a61dbf779dc tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:32.169579 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-c98cbefd-43c1-49b8-b1c1-3a61dbf779dc tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a4c8e15cd44904805c2519c4b6864a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a1542e108d4e3e85fe5525a7e331d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:32.177091 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-c98cbefd-43c1-49b8-b1c1-3a61dbf779dc tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] 10.222.0.13 "GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0" status: 200 len: 1358 microversion: 2.1 time: 0.152071 Jun 23 11:54:32.178318 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 496/1010] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:54:32 2022] GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:54:32.903769 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-97fa6065-925f-484e-9071-1b4cb3a33b4a tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:32.904384 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-97fa6065-925f-484e-9071-1b4cb3a33b4a tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:32.910871 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-97fa6065-925f-484e-9071-1b4cb3a33b4a tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:32.911323 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-97fa6065-925f-484e-9071-1b4cb3a33b4a tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:32.912923 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-97fa6065-925f-484e-9071-1b4cb3a33b4a tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:32.913371 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-97fa6065-925f-484e-9071-1b4cb3a33b4a tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:33.036765 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-97fa6065-925f-484e-9071-1b4cb3a33b4a tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:33.045269 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-97fa6065-925f-484e-9071-1b4cb3a33b4a tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:33.046803 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-97fa6065-925f-484e-9071-1b4cb3a33b4a tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:33.047964 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-97fa6065-925f-484e-9071-1b4cb3a33b4a tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143" status: 200 len: 1746 microversion: 2.20 time: 0.148093 Jun 23 11:54:33.048518 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 497/1011] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:54:32 2022] GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 => generated 1746 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:54:33.194143 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-a7cb140b-865e-4402-b28d-45053d29c649 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:33.194722 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-a7cb140b-865e-4402-b28d-45053d29c649 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] [instance: 06c1d69d-fafe-412e-ac84-49c12c6029d0] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:33.200539 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-a7cb140b-865e-4402-b28d-45053d29c649 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:33.200984 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-a7cb140b-865e-4402-b28d-45053d29c649 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:33.201730 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-a7cb140b-865e-4402-b28d-45053d29c649 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:33.202160 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-a7cb140b-865e-4402-b28d-45053d29c649 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:33.325246 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-a7cb140b-865e-4402-b28d-45053d29c649 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a4c8e15cd44904805c2519c4b6864a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a1542e108d4e3e85fe5525a7e331d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:33.332688 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-a7cb140b-865e-4402-b28d-45053d29c649 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] 10.222.0.13 "GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0" status: 200 len: 1358 microversion: 2.1 time: 0.142696 Jun 23 11:54:33.333224 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 498/1012] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:54:33 2022] GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0 => generated 1358 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:54:34.065556 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-b2b0a3c4-a387-4914-b3d9-aec4adbeedf6 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:34.066198 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-b2b0a3c4-a387-4914-b3d9-aec4adbeedf6 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:34.074021 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-b2b0a3c4-a387-4914-b3d9-aec4adbeedf6 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:34.074476 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-b2b0a3c4-a387-4914-b3d9-aec4adbeedf6 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:34.075280 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-b2b0a3c4-a387-4914-b3d9-aec4adbeedf6 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:34.075717 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-b2b0a3c4-a387-4914-b3d9-aec4adbeedf6 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:34.259713 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-b2b0a3c4-a387-4914-b3d9-aec4adbeedf6 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:34.268047 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-b2b0a3c4-a387-4914-b3d9-aec4adbeedf6 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:34.269549 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-b2b0a3c4-a387-4914-b3d9-aec4adbeedf6 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:34.270771 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-b2b0a3c4-a387-4914-b3d9-aec4adbeedf6 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143" status: 200 len: 1746 microversion: 2.20 time: 0.209187 Jun 23 11:54:34.271324 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 499/1013] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:54:34 2022] GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 => generated 1746 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:54:34.350149 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-24529f6a-2985-4b4a-9129-b920af01ec9c tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:34.350801 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-24529f6a-2985-4b4a-9129-b920af01ec9c tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] [instance: 06c1d69d-fafe-412e-ac84-49c12c6029d0] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:34.357226 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-24529f6a-2985-4b4a-9129-b920af01ec9c tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:34.357675 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-24529f6a-2985-4b4a-9129-b920af01ec9c tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:34.358436 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-24529f6a-2985-4b4a-9129-b920af01ec9c tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:34.358963 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-24529f6a-2985-4b4a-9129-b920af01ec9c tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:34.466880 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-6beccf78-387c-40b9-9776-f509705dfc4c tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "POST /compute/v2.1/servers/f0c76b74-bb63-4f9a-aede-52182140750b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 9.656061 Jun 23 11:54:34.470322 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 515/1014] 10.222.0.13 () {60 vars in 1322 bytes} [Thu Jun 23 11:54:24 2022] POST /compute/v2.1/servers/f0c76b74-bb63-4f9a-aede-52182140750b/os-volume_attachments => generated 194 bytes in 9658 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:54:34.586484 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-24529f6a-2985-4b4a-9129-b920af01ec9c tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a4c8e15cd44904805c2519c4b6864a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a1542e108d4e3e85fe5525a7e331d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:34.600192 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-24529f6a-2985-4b4a-9129-b920af01ec9c tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] 10.222.0.13 "GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0" status: 200 len: 1358 microversion: 2.1 time: 0.248710 Jun 23 11:54:34.600192 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 500/1015] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:54:34 2022] GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0 => generated 1358 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:54:34.769464 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [req-1a197f6a-7be6-4154-9262-26a3a528465a req-1133839c-f9ab-4052-a871-27845069db79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06c1d69d-fafe-412e-ac84-49c12c6029d0", "tag": "2f36a3ef-b1bd-48d9-8060-f3cbb922568c"}]} {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:54:34.781167 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-1a197f6a-7be6-4154-9262-26a3a528465a req-1133839c-f9ab-4052-a871-27845069db79 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:34.781922 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-1a197f6a-7be6-4154-9262-26a3a528465a req-1133839c-f9ab-4052-a871-27845069db79 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:34.794494 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.compute.server_external_events [req-1a197f6a-7be6-4154-9262-26a3a528465a req-1133839c-f9ab-4052-a871-27845069db79 service nova] Creating event network-changed:2f36a3ef-b1bd-48d9-8060-f3cbb922568c for instance 06c1d69d-fafe-412e-ac84-49c12c6029d0 on hv-cinder-82099 Jun 23 11:54:34.799844 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [req-1a197f6a-7be6-4154-9262-26a3a528465a req-1133839c-f9ab-4052-a871-27845069db79 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035722 Jun 23 11:54:34.800472 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 516/1016] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:54:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:54:35.290167 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-c7a1eb0a-b2cb-4480-ae9f-451a004093f0 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:35.290921 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-c7a1eb0a-b2cb-4480-ae9f-451a004093f0 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:35.297825 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c7a1eb0a-b2cb-4480-ae9f-451a004093f0 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:35.298334 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c7a1eb0a-b2cb-4480-ae9f-451a004093f0 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:35.299181 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c7a1eb0a-b2cb-4480-ae9f-451a004093f0 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:35.299687 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c7a1eb0a-b2cb-4480-ae9f-451a004093f0 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:35.505155 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-c7a1eb0a-b2cb-4480-ae9f-451a004093f0 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:35.513277 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-c7a1eb0a-b2cb-4480-ae9f-451a004093f0 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:35.514789 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-c7a1eb0a-b2cb-4480-ae9f-451a004093f0 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:35.516131 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-c7a1eb0a-b2cb-4480-ae9f-451a004093f0 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143" status: 200 len: 1741 microversion: 2.20 time: 0.230892 Jun 23 11:54:35.516644 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 501/1017] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:54:35 2022] GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 => generated 1741 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:54:35.613363 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-1f1b1460-9fdb-4977-bd83-66e02b49eef8 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:35.618489 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-1f1b1460-9fdb-4977-bd83-66e02b49eef8 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] [instance: 06c1d69d-fafe-412e-ac84-49c12c6029d0] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:35.623429 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1f1b1460-9fdb-4977-bd83-66e02b49eef8 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:35.623938 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1f1b1460-9fdb-4977-bd83-66e02b49eef8 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:35.624845 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1f1b1460-9fdb-4977-bd83-66e02b49eef8 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:35.625653 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1f1b1460-9fdb-4977-bd83-66e02b49eef8 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:35.774061 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-1f1b1460-9fdb-4977-bd83-66e02b49eef8 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a4c8e15cd44904805c2519c4b6864a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a1542e108d4e3e85fe5525a7e331d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:35.781534 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-1f1b1460-9fdb-4977-bd83-66e02b49eef8 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] 10.222.0.13 "GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0" status: 200 len: 1358 microversion: 2.1 time: 0.173102 Jun 23 11:54:35.782090 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 517/1018] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:54:35 2022] GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:54:36.540855 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-e41f8d08-a586-4190-9108-73d5d0247cc5 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:36.542159 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-e41f8d08-a586-4190-9108-73d5d0247cc5 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:36.549166 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-e41f8d08-a586-4190-9108-73d5d0247cc5 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:36.550421 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-e41f8d08-a586-4190-9108-73d5d0247cc5 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:36.550421 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-e41f8d08-a586-4190-9108-73d5d0247cc5 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:36.550804 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-e41f8d08-a586-4190-9108-73d5d0247cc5 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:36.719976 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-e41f8d08-a586-4190-9108-73d5d0247cc5 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:36.753393 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-e41f8d08-a586-4190-9108-73d5d0247cc5 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:36.753393 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-e41f8d08-a586-4190-9108-73d5d0247cc5 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:36.753393 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-e41f8d08-a586-4190-9108-73d5d0247cc5 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143" status: 200 len: 1741 microversion: 2.20 time: 0.207233 Jun 23 11:54:36.753843 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 502/1019] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:54:36 2022] GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 => generated 1741 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:54:36.799321 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-3bd96f28-e262-4b20-a228-3673b0459f12 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:36.801001 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-3bd96f28-e262-4b20-a228-3673b0459f12 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] [instance: 06c1d69d-fafe-412e-ac84-49c12c6029d0] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:36.808999 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-3bd96f28-e262-4b20-a228-3673b0459f12 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:36.809453 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-3bd96f28-e262-4b20-a228-3673b0459f12 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:36.810223 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-3bd96f28-e262-4b20-a228-3673b0459f12 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:36.810721 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-3bd96f28-e262-4b20-a228-3673b0459f12 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:36.945019 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-3bd96f28-e262-4b20-a228-3673b0459f12 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a4c8e15cd44904805c2519c4b6864a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a1542e108d4e3e85fe5525a7e331d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:36.953207 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-3bd96f28-e262-4b20-a228-3673b0459f12 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] 10.222.0.13 "GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0" status: 200 len: 1358 microversion: 2.1 time: 0.157789 Jun 23 11:54:36.954170 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 518/1020] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:54:36 2022] GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:54:37.772756 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-d829d536-3b8e-4e14-b537-f12fe6f8a7d2 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:37.773333 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-d829d536-3b8e-4e14-b537-f12fe6f8a7d2 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:37.780137 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-d829d536-3b8e-4e14-b537-f12fe6f8a7d2 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:37.780823 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-d829d536-3b8e-4e14-b537-f12fe6f8a7d2 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:37.781596 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-d829d536-3b8e-4e14-b537-f12fe6f8a7d2 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:37.782037 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-d829d536-3b8e-4e14-b537-f12fe6f8a7d2 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:37.924440 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-d829d536-3b8e-4e14-b537-f12fe6f8a7d2 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:37.933924 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-d829d536-3b8e-4e14-b537-f12fe6f8a7d2 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:37.935459 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-d829d536-3b8e-4e14-b537-f12fe6f8a7d2 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:37.936632 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-d829d536-3b8e-4e14-b537-f12fe6f8a7d2 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143" status: 200 len: 1741 microversion: 2.20 time: 0.178619 Jun 23 11:54:37.937183 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 503/1021] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:54:37 2022] GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 => generated 1741 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:54:37.970213 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-55b81a57-61d7-47e4-a5e8-37b0a38d5d34 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:37.971574 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-55b81a57-61d7-47e4-a5e8-37b0a38d5d34 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] [instance: 06c1d69d-fafe-412e-ac84-49c12c6029d0] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:37.978650 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-55b81a57-61d7-47e4-a5e8-37b0a38d5d34 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:37.979103 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-55b81a57-61d7-47e4-a5e8-37b0a38d5d34 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:37.979857 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-55b81a57-61d7-47e4-a5e8-37b0a38d5d34 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:37.980466 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-55b81a57-61d7-47e4-a5e8-37b0a38d5d34 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:38.119878 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-55b81a57-61d7-47e4-a5e8-37b0a38d5d34 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a4c8e15cd44904805c2519c4b6864a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a1542e108d4e3e85fe5525a7e331d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:38.133439 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-55b81a57-61d7-47e4-a5e8-37b0a38d5d34 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] 10.222.0.13 "GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0" status: 200 len: 1358 microversion: 2.1 time: 0.167263 Jun 23 11:54:38.139414 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 519/1022] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:54:37 2022] GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:54:38.955546 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-5b4ac8f7-3de7-4dd8-8811-5677c1020536 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:38.956173 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-5b4ac8f7-3de7-4dd8-8811-5677c1020536 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:38.963181 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-5b4ac8f7-3de7-4dd8-8811-5677c1020536 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:38.963628 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-5b4ac8f7-3de7-4dd8-8811-5677c1020536 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:38.964381 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-5b4ac8f7-3de7-4dd8-8811-5677c1020536 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:38.964813 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-5b4ac8f7-3de7-4dd8-8811-5677c1020536 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:38.983653 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_cell1:SELECT=100 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:54:39.097541 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-5b4ac8f7-3de7-4dd8-8811-5677c1020536 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:39.116085 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-5b4ac8f7-3de7-4dd8-8811-5677c1020536 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:39.116085 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-5b4ac8f7-3de7-4dd8-8811-5677c1020536 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:39.116085 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-5b4ac8f7-3de7-4dd8-8811-5677c1020536 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143" status: 200 len: 1741 microversion: 2.20 time: 0.159458 Jun 23 11:54:39.116720 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 504/1023] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:54:38 2022] GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 => generated 1741 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:54:39.150687 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-128dcdec-0ff6-4778-a2b0-3000e89f6a3d tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:39.151305 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-128dcdec-0ff6-4778-a2b0-3000e89f6a3d tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] [instance: 06c1d69d-fafe-412e-ac84-49c12c6029d0] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:39.157734 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-128dcdec-0ff6-4778-a2b0-3000e89f6a3d tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:39.158190 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-128dcdec-0ff6-4778-a2b0-3000e89f6a3d tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:39.158976 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-128dcdec-0ff6-4778-a2b0-3000e89f6a3d tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:39.159416 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-128dcdec-0ff6-4778-a2b0-3000e89f6a3d tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:39.300074 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-128dcdec-0ff6-4778-a2b0-3000e89f6a3d tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a4c8e15cd44904805c2519c4b6864a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a1542e108d4e3e85fe5525a7e331d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:39.309047 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-128dcdec-0ff6-4778-a2b0-3000e89f6a3d tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] 10.222.0.13 "GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0" status: 200 len: 1358 microversion: 2.1 time: 0.162616 Jun 23 11:54:39.310147 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 520/1024] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:54:39 2022] GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:54:40.132418 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-c016f689-dfb6-4970-ae84-284e16c54f50 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:40.133058 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-c016f689-dfb6-4970-ae84-284e16c54f50 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:40.140153 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c016f689-dfb6-4970-ae84-284e16c54f50 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:40.140597 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c016f689-dfb6-4970-ae84-284e16c54f50 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:40.141563 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c016f689-dfb6-4970-ae84-284e16c54f50 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:40.141994 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c016f689-dfb6-4970-ae84-284e16c54f50 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:40.279553 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-c016f689-dfb6-4970-ae84-284e16c54f50 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:40.289861 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-c016f689-dfb6-4970-ae84-284e16c54f50 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:40.291637 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-c016f689-dfb6-4970-ae84-284e16c54f50 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:40.292811 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-c016f689-dfb6-4970-ae84-284e16c54f50 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143" status: 200 len: 1741 microversion: 2.20 time: 0.164841 Jun 23 11:54:40.293808 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 505/1025] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:54:40 2022] GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 => generated 1741 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:54:40.325447 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-98f4ba4b-5712-4bdb-903e-85149159b54a tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:40.326149 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-98f4ba4b-5712-4bdb-903e-85149159b54a tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] [instance: 06c1d69d-fafe-412e-ac84-49c12c6029d0] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:40.332758 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-98f4ba4b-5712-4bdb-903e-85149159b54a tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:40.333455 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-98f4ba4b-5712-4bdb-903e-85149159b54a tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:40.334649 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-98f4ba4b-5712-4bdb-903e-85149159b54a tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:40.335154 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-98f4ba4b-5712-4bdb-903e-85149159b54a tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:40.492203 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-98f4ba4b-5712-4bdb-903e-85149159b54a tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a4c8e15cd44904805c2519c4b6864a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a1542e108d4e3e85fe5525a7e331d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:40.504423 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-98f4ba4b-5712-4bdb-903e-85149159b54a tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] 10.222.0.13 "GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0" status: 200 len: 1358 microversion: 2.1 time: 0.182753 Jun 23 11:54:40.505086 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 521/1026] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:54:40 2022] GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0 => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:54:41.311710 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-54d440a7-370e-43a1-b51e-2c2757c570f9 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:41.312587 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-54d440a7-370e-43a1-b51e-2c2757c570f9 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:41.320038 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-54d440a7-370e-43a1-b51e-2c2757c570f9 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:41.320491 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-54d440a7-370e-43a1-b51e-2c2757c570f9 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:41.321900 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-54d440a7-370e-43a1-b51e-2c2757c570f9 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:41.322353 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-54d440a7-370e-43a1-b51e-2c2757c570f9 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:41.486357 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-54d440a7-370e-43a1-b51e-2c2757c570f9 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:41.501079 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-54d440a7-370e-43a1-b51e-2c2757c570f9 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:41.503139 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-54d440a7-370e-43a1-b51e-2c2757c570f9 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:41.504550 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-54d440a7-370e-43a1-b51e-2c2757c570f9 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143" status: 200 len: 1741 microversion: 2.20 time: 0.196819 Jun 23 11:54:41.511906 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 506/1027] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:54:41 2022] GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 => generated 1741 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:54:41.523533 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-689d80ba-6957-4ce8-8ada-82c8f1b8c1cd tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:41.524147 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-689d80ba-6957-4ce8-8ada-82c8f1b8c1cd tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] [instance: 06c1d69d-fafe-412e-ac84-49c12c6029d0] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:41.532540 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-689d80ba-6957-4ce8-8ada-82c8f1b8c1cd tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:41.533285 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-689d80ba-6957-4ce8-8ada-82c8f1b8c1cd tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:41.534256 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-689d80ba-6957-4ce8-8ada-82c8f1b8c1cd tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:41.534902 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-689d80ba-6957-4ce8-8ada-82c8f1b8c1cd tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:41.683426 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-689d80ba-6957-4ce8-8ada-82c8f1b8c1cd tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a4c8e15cd44904805c2519c4b6864a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a1542e108d4e3e85fe5525a7e331d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:41.692405 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-689d80ba-6957-4ce8-8ada-82c8f1b8c1cd tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] 10.222.0.13 "GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0" status: 200 len: 1358 microversion: 2.1 time: 0.173062 Jun 23 11:54:41.692990 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 522/1028] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:54:41 2022] GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:54:42.530711 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-fb94659f-2c99-4ac7-99f8-50e8137b8a4e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:42.530711 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-fb94659f-2c99-4ac7-99f8-50e8137b8a4e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:42.532499 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-fb94659f-2c99-4ac7-99f8-50e8137b8a4e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:42.532950 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-fb94659f-2c99-4ac7-99f8-50e8137b8a4e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:42.533744 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-fb94659f-2c99-4ac7-99f8-50e8137b8a4e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:42.534183 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-fb94659f-2c99-4ac7-99f8-50e8137b8a4e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:42.690164 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-fb94659f-2c99-4ac7-99f8-50e8137b8a4e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:42.699284 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-fb94659f-2c99-4ac7-99f8-50e8137b8a4e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:42.700830 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-fb94659f-2c99-4ac7-99f8-50e8137b8a4e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:42.702029 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-fb94659f-2c99-4ac7-99f8-50e8137b8a4e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143" status: 200 len: 1741 microversion: 2.20 time: 0.182758 Jun 23 11:54:42.702888 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 507/1029] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:54:42 2022] GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 => generated 1741 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:54:42.709280 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-87ddc11d-c6b7-4e75-916b-e6248d7a6e08 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:42.710089 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-87ddc11d-c6b7-4e75-916b-e6248d7a6e08 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] [instance: 06c1d69d-fafe-412e-ac84-49c12c6029d0] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:42.716914 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-87ddc11d-c6b7-4e75-916b-e6248d7a6e08 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:42.717363 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-87ddc11d-c6b7-4e75-916b-e6248d7a6e08 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:42.718104 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-87ddc11d-c6b7-4e75-916b-e6248d7a6e08 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:42.718551 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-87ddc11d-c6b7-4e75-916b-e6248d7a6e08 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:42.739209 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:54:42.846733 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [req-dce70b65-54ca-4221-9f29-aae4b8eae827 req-230b81fa-c85d-4dc9-9d86-ebca3e332020 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06c1d69d-fafe-412e-ac84-49c12c6029d0", "name": "network-vif-plugged", "status": "completed", "tag": "2f36a3ef-b1bd-48d9-8060-f3cbb922568c"}]} {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:54:42.858093 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [req-dce70b65-54ca-4221-9f29-aae4b8eae827 req-230b81fa-c85d-4dc9-9d86-ebca3e332020 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:42.858748 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [req-dce70b65-54ca-4221-9f29-aae4b8eae827 req-230b81fa-c85d-4dc9-9d86-ebca3e332020 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:42.875004 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.compute.server_external_events [req-dce70b65-54ca-4221-9f29-aae4b8eae827 req-230b81fa-c85d-4dc9-9d86-ebca3e332020 service nova] Creating event network-vif-plugged:2f36a3ef-b1bd-48d9-8060-f3cbb922568c for instance 06c1d69d-fafe-412e-ac84-49c12c6029d0 on hv-cinder-82099 Jun 23 11:54:42.880533 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [req-dce70b65-54ca-4221-9f29-aae4b8eae827 req-230b81fa-c85d-4dc9-9d86-ebca3e332020 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041140 Jun 23 11:54:42.882614 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 508/1030] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:54:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:54:42.907023 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-87ddc11d-c6b7-4e75-916b-e6248d7a6e08 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a4c8e15cd44904805c2519c4b6864a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a1542e108d4e3e85fe5525a7e331d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:42.916900 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-87ddc11d-c6b7-4e75-916b-e6248d7a6e08 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] 10.222.0.13 "GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0" status: 200 len: 1358 microversion: 2.1 time: 0.211511 Jun 23 11:54:42.917689 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 523/1031] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:54:42 2022] GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0 => generated 1358 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:54:43.141749 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-c13c7c2a-7253-49df-8422-12258519d460 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:43.142851 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-c13c7c2a-7253-49df-8422-12258519d460 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: f0c76b74-bb63-4f9a-aede-52182140750b] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:43.150631 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c13c7c2a-7253-49df-8422-12258519d460 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:43.151202 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c13c7c2a-7253-49df-8422-12258519d460 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:43.152365 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c13c7c2a-7253-49df-8422-12258519d460 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:43.152503 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c13c7c2a-7253-49df-8422-12258519d460 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:43.201053 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-c13c7c2a-7253-49df-8422-12258519d460 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/f0c76b74-bb63-4f9a-aede-52182140750b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063235 Jun 23 11:54:43.206938 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 509/1032] 10.222.0.13 () {58 vars in 1301 bytes} [Thu Jun 23 11:54:43 2022] GET /compute/v2.1/servers/f0c76b74-bb63-4f9a-aede-52182140750b/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:54:43.214011 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-69075062-e9b9-4167-ab2e-fa203413e7e7 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:43.215367 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-69075062-e9b9-4167-ab2e-fa203413e7e7 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: f0c76b74-bb63-4f9a-aede-52182140750b] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:43.224134 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-69075062-e9b9-4167-ab2e-fa203413e7e7 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:43.225344 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-69075062-e9b9-4167-ab2e-fa203413e7e7 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:43.226691 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-69075062-e9b9-4167-ab2e-fa203413e7e7 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:43.227387 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-69075062-e9b9-4167-ab2e-fa203413e7e7 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:43.271479 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-69075062-e9b9-4167-ab2e-fa203413e7e7 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/f0c76b74-bb63-4f9a-aede-52182140750b/os-volume_attachments/1fb2618e-d788-4fb1-96e2-6478a7bb4136" status: 200 len: 194 microversion: 2.1 time: 0.062580 Jun 23 11:54:43.279357 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 524/1033] 10.222.0.13 () {58 vars in 1412 bytes} [Thu Jun 23 11:54:43 2022] GET /compute/v2.1/servers/f0c76b74-bb63-4f9a-aede-52182140750b/os-volume_attachments/1fb2618e-d788-4fb1-96e2-6478a7bb4136 => generated 194 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:54:43.721612 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-166c0dd6-2e55-4b1f-bd05-9b0c956ba9d9 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:43.722407 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-166c0dd6-2e55-4b1f-bd05-9b0c956ba9d9 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:43.729858 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-166c0dd6-2e55-4b1f-bd05-9b0c956ba9d9 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:43.730450 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-166c0dd6-2e55-4b1f-bd05-9b0c956ba9d9 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:43.731459 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-166c0dd6-2e55-4b1f-bd05-9b0c956ba9d9 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:43.732050 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-166c0dd6-2e55-4b1f-bd05-9b0c956ba9d9 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:43.915999 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-166c0dd6-2e55-4b1f-bd05-9b0c956ba9d9 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:43.924654 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-166c0dd6-2e55-4b1f-bd05-9b0c956ba9d9 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:43.926256 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-166c0dd6-2e55-4b1f-bd05-9b0c956ba9d9 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:43.927990 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-166c0dd6-2e55-4b1f-bd05-9b0c956ba9d9 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143" status: 200 len: 1741 microversion: 2.20 time: 0.210532 Jun 23 11:54:43.939677 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 510/1034] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:54:43 2022] GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 => generated 1741 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:54:43.944594 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-52a8dcf9-ca48-403f-be4c-4dbd3e0cc8d0 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:43.949995 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-52a8dcf9-ca48-403f-be4c-4dbd3e0cc8d0 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] [instance: 06c1d69d-fafe-412e-ac84-49c12c6029d0] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:43.961341 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-52a8dcf9-ca48-403f-be4c-4dbd3e0cc8d0 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:43.961820 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-52a8dcf9-ca48-403f-be4c-4dbd3e0cc8d0 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:43.962760 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-52a8dcf9-ca48-403f-be4c-4dbd3e0cc8d0 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:43.963195 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-52a8dcf9-ca48-403f-be4c-4dbd3e0cc8d0 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:44.136907 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-52a8dcf9-ca48-403f-be4c-4dbd3e0cc8d0 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a4c8e15cd44904805c2519c4b6864a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a1542e108d4e3e85fe5525a7e331d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:44.146043 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-52a8dcf9-ca48-403f-be4c-4dbd3e0cc8d0 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] 10.222.0.13 "GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0" status: 200 len: 1358 microversion: 2.1 time: 0.216272 Jun 23 11:54:44.147852 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 525/1035] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:54:43 2022] GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0 => generated 1358 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:54:44.898861 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-f5eaeb5f-2627-4b88-b445-c8e619c2856d tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "555a71f8-daca-40a5-a305-82a5b277c285"}} {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:54:44.899930 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-f5eaeb5f-2627-4b88-b445-c8e619c2856d tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: f0c76b74-bb63-4f9a-aede-52182140750b] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:44.907024 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-f5eaeb5f-2627-4b88-b445-c8e619c2856d tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:44.907496 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-f5eaeb5f-2627-4b88-b445-c8e619c2856d tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:44.908288 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-f5eaeb5f-2627-4b88-b445-c8e619c2856d tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:44.908726 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-f5eaeb5f-2627-4b88-b445-c8e619c2856d tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:44.947375 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-42227384-1348-4080-a58f-0e68454b18f1 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:44.947983 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-42227384-1348-4080-a58f-0e68454b18f1 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:44.955882 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-42227384-1348-4080-a58f-0e68454b18f1 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:44.956327 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-42227384-1348-4080-a58f-0e68454b18f1 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:44.957285 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-42227384-1348-4080-a58f-0e68454b18f1 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:44.957714 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-42227384-1348-4080-a58f-0e68454b18f1 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:45.099083 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-42227384-1348-4080-a58f-0e68454b18f1 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:45.108996 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-42227384-1348-4080-a58f-0e68454b18f1 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:45.110770 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-42227384-1348-4080-a58f-0e68454b18f1 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:45.112050 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-42227384-1348-4080-a58f-0e68454b18f1 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143" status: 200 len: 1741 microversion: 2.20 time: 0.169419 Jun 23 11:54:45.122936 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 526/1036] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:54:44 2022] GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 => generated 1741 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:54:45.166199 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-c4e8cd48-3961-4b9c-b545-594a11b629c2 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:45.166952 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-c4e8cd48-3961-4b9c-b545-594a11b629c2 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] [instance: 06c1d69d-fafe-412e-ac84-49c12c6029d0] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:45.173185 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-c4e8cd48-3961-4b9c-b545-594a11b629c2 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:45.173725 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-c4e8cd48-3961-4b9c-b545-594a11b629c2 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:45.174479 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-c4e8cd48-3961-4b9c-b545-594a11b629c2 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:45.174936 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-c4e8cd48-3961-4b9c-b545-594a11b629c2 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:45.322326 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-c4e8cd48-3961-4b9c-b545-594a11b629c2 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a4c8e15cd44904805c2519c4b6864a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a1542e108d4e3e85fe5525a7e331d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:45.330139 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-c4e8cd48-3961-4b9c-b545-594a11b629c2 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] 10.222.0.13 "GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0" status: 200 len: 1358 microversion: 2.1 time: 0.169943 Jun 23 11:54:45.330803 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 527/1037] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:54:45 2022] GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:54:46.131887 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-a02320a8-107c-4eea-8fe8-73d3be3bab59 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:46.132566 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-a02320a8-107c-4eea-8fe8-73d3be3bab59 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:46.139069 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a02320a8-107c-4eea-8fe8-73d3be3bab59 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:46.139511 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a02320a8-107c-4eea-8fe8-73d3be3bab59 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:46.143369 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a02320a8-107c-4eea-8fe8-73d3be3bab59 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:46.143369 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a02320a8-107c-4eea-8fe8-73d3be3bab59 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:46.284477 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-a02320a8-107c-4eea-8fe8-73d3be3bab59 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:46.293485 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-a02320a8-107c-4eea-8fe8-73d3be3bab59 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:46.295267 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-a02320a8-107c-4eea-8fe8-73d3be3bab59 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:46.296653 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-a02320a8-107c-4eea-8fe8-73d3be3bab59 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143" status: 200 len: 1741 microversion: 2.20 time: 0.169168 Jun 23 11:54:46.297664 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 528/1038] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:54:46 2022] GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 => generated 1741 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:54:46.317241 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-f5eaeb5f-2627-4b88-b445-c8e619c2856d tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "POST /compute/v2.1/servers/f0c76b74-bb63-4f9a-aede-52182140750b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.423326 Jun 23 11:54:46.324751 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 511/1039] 10.222.0.13 () {60 vars in 1322 bytes} [Thu Jun 23 11:54:44 2022] POST /compute/v2.1/servers/f0c76b74-bb63-4f9a-aede-52182140750b/os-volume_attachments => generated 194 bytes in 1432 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:54:46.349367 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-a10fd0cb-fd70-4b8d-945e-1ccfa731d5e7 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:46.351038 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-a10fd0cb-fd70-4b8d-945e-1ccfa731d5e7 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] [instance: 06c1d69d-fafe-412e-ac84-49c12c6029d0] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:46.358956 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a10fd0cb-fd70-4b8d-945e-1ccfa731d5e7 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:46.359499 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a10fd0cb-fd70-4b8d-945e-1ccfa731d5e7 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:46.360482 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a10fd0cb-fd70-4b8d-945e-1ccfa731d5e7 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:46.361072 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a10fd0cb-fd70-4b8d-945e-1ccfa731d5e7 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:46.541637 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-a10fd0cb-fd70-4b8d-945e-1ccfa731d5e7 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a4c8e15cd44904805c2519c4b6864a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a1542e108d4e3e85fe5525a7e331d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:46.549995 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-a10fd0cb-fd70-4b8d-945e-1ccfa731d5e7 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] 10.222.0.13 "GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0" status: 200 len: 1548 microversion: 2.1 time: 0.205228 Jun 23 11:54:46.551246 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 529/1040] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:54:46 2022] GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0 => generated 1548 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:54:46.569171 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-28e7d304-aa3b-46f0-b354-ec5201e2496f tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:46.570982 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-28e7d304-aa3b-46f0-b354-ec5201e2496f tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] [instance: 06c1d69d-fafe-412e-ac84-49c12c6029d0] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:46.579105 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-28e7d304-aa3b-46f0-b354-ec5201e2496f tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:46.579637 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-28e7d304-aa3b-46f0-b354-ec5201e2496f tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:46.580607 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-28e7d304-aa3b-46f0-b354-ec5201e2496f tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:46.581151 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-28e7d304-aa3b-46f0-b354-ec5201e2496f tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:46.733315 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-28e7d304-aa3b-46f0-b354-ec5201e2496f tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a4c8e15cd44904805c2519c4b6864a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a1542e108d4e3e85fe5525a7e331d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:46.759530 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-28e7d304-aa3b-46f0-b354-ec5201e2496f tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] 10.222.0.13 "GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0" status: 200 len: 1548 microversion: 2.1 time: 0.196614 Jun 23 11:54:46.760355 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 512/1041] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:54:46 2022] GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0 => generated 1548 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:54:46.776614 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-4e02e5e5-f313-4011-96f9-4bc47da338b3 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:46.780207 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-4e02e5e5-f313-4011-96f9-4bc47da338b3 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '15a4c8e15cd44904805c2519c4b6864a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a1542e108d4e3e85fe5525a7e331d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:46.780972 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-4e02e5e5-f313-4011-96f9-4bc47da338b3 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Searching by: {'deleted': False, 'project_id': '17a1542e108d4e3e85fe5525a7e331d0'} {{(pid=124670) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 23 11:54:46.788154 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-4e02e5e5-f313-4011-96f9-4bc47da338b3 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:46.788591 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-4e02e5e5-f313-4011-96f9-4bc47da338b3 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:46.789377 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-4e02e5e5-f313-4011-96f9-4bc47da338b3 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:46.789803 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-4e02e5e5-f313-4011-96f9-4bc47da338b3 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:46.891418 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.multi_cell_list [None req-4e02e5e5-f313-4011-96f9-4bc47da338b3 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124670) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 23 11:54:46.987214 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-4e02e5e5-f313-4011-96f9-4bc47da338b3 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] 10.222.0.13 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.214415 Jun 23 11:54:46.987800 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 530/1042] 10.222.0.13 () {58 vars in 1124 bytes} [Thu Jun 23 11:54:46 2022] GET /compute/v2.1/servers => generated 343 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:54:46.998938 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-c6065871-419c-4bde-b04f-5d23534f8a68 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:46.999544 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-c6065871-419c-4bde-b04f-5d23534f8a68 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] [instance: 06c1d69d-fafe-412e-ac84-49c12c6029d0] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:47.005464 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c6065871-419c-4bde-b04f-5d23534f8a68 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:47.006321 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c6065871-419c-4bde-b04f-5d23534f8a68 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:47.007119 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c6065871-419c-4bde-b04f-5d23534f8a68 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:47.007550 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c6065871-419c-4bde-b04f-5d23534f8a68 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:47.135455 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-c6065871-419c-4bde-b04f-5d23534f8a68 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a4c8e15cd44904805c2519c4b6864a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a1542e108d4e3e85fe5525a7e331d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:47.142971 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-c6065871-419c-4bde-b04f-5d23534f8a68 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] 10.222.0.13 "GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0" status: 200 len: 1548 microversion: 2.1 time: 0.147731 Jun 23 11:54:47.143466 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 513/1043] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:54:46 2022] GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0 => generated 1548 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:54:47.316170 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-91ddb595-26e0-4478-a3bc-4c7942dc1eb5 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:47.316771 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-91ddb595-26e0-4478-a3bc-4c7942dc1eb5 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:47.323617 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-91ddb595-26e0-4478-a3bc-4c7942dc1eb5 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:47.324061 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-91ddb595-26e0-4478-a3bc-4c7942dc1eb5 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:47.324801 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-91ddb595-26e0-4478-a3bc-4c7942dc1eb5 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:47.325227 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-91ddb595-26e0-4478-a3bc-4c7942dc1eb5 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:47.629200 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-91ddb595-26e0-4478-a3bc-4c7942dc1eb5 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:47.637828 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-91ddb595-26e0-4478-a3bc-4c7942dc1eb5 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:47.639332 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-91ddb595-26e0-4478-a3bc-4c7942dc1eb5 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:47.640488 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-91ddb595-26e0-4478-a3bc-4c7942dc1eb5 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143" status: 200 len: 1741 microversion: 2.20 time: 0.328295 Jun 23 11:54:47.641033 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 531/1044] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:54:47 2022] GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 => generated 1741 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:54:48.659676 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-30cbc9da-105e-476b-a3c6-1d0d9ce67445 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:48.660368 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-30cbc9da-105e-476b-a3c6-1d0d9ce67445 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:48.667193 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-30cbc9da-105e-476b-a3c6-1d0d9ce67445 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:48.674074 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-30cbc9da-105e-476b-a3c6-1d0d9ce67445 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:48.674074 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-30cbc9da-105e-476b-a3c6-1d0d9ce67445 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:48.674074 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-30cbc9da-105e-476b-a3c6-1d0d9ce67445 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:48.889674 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-30cbc9da-105e-476b-a3c6-1d0d9ce67445 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:48.898925 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-30cbc9da-105e-476b-a3c6-1d0d9ce67445 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:48.900752 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-30cbc9da-105e-476b-a3c6-1d0d9ce67445 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:48.902074 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-30cbc9da-105e-476b-a3c6-1d0d9ce67445 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143" status: 200 len: 1723 microversion: 2.20 time: 0.246295 Jun 23 11:54:48.911467 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 514/1045] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:54:48 2022] GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 => generated 1723 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:54:49.081621 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-eaf26756-e76a-4707-a68e-d090a038f161 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "29ecd8ea-6be5-4ff0-8be1-c2b2e3ebd7c0"}} {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:54:49.082843 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-eaf26756-e76a-4707-a68e-d090a038f161 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] [instance: 06c1d69d-fafe-412e-ac84-49c12c6029d0] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:49.089809 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-eaf26756-e76a-4707-a68e-d090a038f161 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:49.090258 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-eaf26756-e76a-4707-a68e-d090a038f161 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:49.091056 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-eaf26756-e76a-4707-a68e-d090a038f161 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:49.091488 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-eaf26756-e76a-4707-a68e-d090a038f161 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:49.921136 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-3734e4f8-0ac4-4aee-82e8-795b3b880d6a tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:49.921715 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-3734e4f8-0ac4-4aee-82e8-795b3b880d6a tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:49.928270 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-3734e4f8-0ac4-4aee-82e8-795b3b880d6a tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:49.928734 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-3734e4f8-0ac4-4aee-82e8-795b3b880d6a tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:49.929487 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-3734e4f8-0ac4-4aee-82e8-795b3b880d6a tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:49.929923 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-3734e4f8-0ac4-4aee-82e8-795b3b880d6a tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:50.062671 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-3734e4f8-0ac4-4aee-82e8-795b3b880d6a tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:50.071230 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-3734e4f8-0ac4-4aee-82e8-795b3b880d6a tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:50.072720 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-3734e4f8-0ac4-4aee-82e8-795b3b880d6a tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:50.073865 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-3734e4f8-0ac4-4aee-82e8-795b3b880d6a tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143" status: 200 len: 1723 microversion: 2.20 time: 0.156735 Jun 23 11:54:50.074409 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 515/1046] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:54:49 2022] GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:54:50.647208 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [req-cc4146e7-f774-4e77-85dd-a64765a7b6c6 req-5fe2824f-4a73-4e7a-a506-9df070208372 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e51258d-c99d-4d15-8463-c699bcfa9143", "name": "network-vif-unplugged", "status": "completed", "tag": "2fc09618-5ffd-4c12-8072-c756814d925d"}]} {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:54:50.655325 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [req-cc4146e7-f774-4e77-85dd-a64765a7b6c6 req-5fe2824f-4a73-4e7a-a506-9df070208372 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:50.655767 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [req-cc4146e7-f774-4e77-85dd-a64765a7b6c6 req-5fe2824f-4a73-4e7a-a506-9df070208372 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:50.667213 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.compute.server_external_events [req-cc4146e7-f774-4e77-85dd-a64765a7b6c6 req-5fe2824f-4a73-4e7a-a506-9df070208372 service nova] Creating event network-vif-unplugged:2fc09618-5ffd-4c12-8072-c756814d925d for instance 1e51258d-c99d-4d15-8463-c699bcfa9143 on hv-cinder-82099 Jun 23 11:54:50.672385 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [req-cc4146e7-f774-4e77-85dd-a64765a7b6c6 req-5fe2824f-4a73-4e7a-a506-9df070208372 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028953 Jun 23 11:54:50.672927 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 516/1047] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:54:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:54:51.080934 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-eaf26756-e76a-4707-a68e-d090a038f161 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] 10.222.0.13 "POST /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.003048 Jun 23 11:54:51.081575 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 532/1048] 10.222.0.13 () {60 vars in 1322 bytes} [Thu Jun 23 11:54:49 2022] POST /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0/os-volume_attachments => generated 194 bytes in 2004 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:54:51.099957 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-d1c053bf-00c3-4f0c-9e8a-10515510e04b tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:51.100653 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-d1c053bf-00c3-4f0c-9e8a-10515510e04b tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:51.107783 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-d1c053bf-00c3-4f0c-9e8a-10515510e04b tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:51.111198 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-d1c053bf-00c3-4f0c-9e8a-10515510e04b tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:51.111198 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-d1c053bf-00c3-4f0c-9e8a-10515510e04b tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:51.111198 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-d1c053bf-00c3-4f0c-9e8a-10515510e04b tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:51.238915 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-d1c053bf-00c3-4f0c-9e8a-10515510e04b tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:51.246959 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-d1c053bf-00c3-4f0c-9e8a-10515510e04b tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:51.248457 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-d1c053bf-00c3-4f0c-9e8a-10515510e04b tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:51.249637 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-d1c053bf-00c3-4f0c-9e8a-10515510e04b tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143" status: 200 len: 1726 microversion: 2.20 time: 0.160831 Jun 23 11:54:51.250190 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 517/1049] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:54:51 2022] GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 => generated 1726 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:54:51.268225 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-1857c502-6dc8-479e-810a-7b83480266f0 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "65e56853-c870-4e48-ac0f-109d28a59058"}} {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:54:51.269628 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-1857c502-6dc8-479e-810a-7b83480266f0 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:51.276790 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1857c502-6dc8-479e-810a-7b83480266f0 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:51.277243 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1857c502-6dc8-479e-810a-7b83480266f0 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:51.278046 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1857c502-6dc8-479e-810a-7b83480266f0 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:51.278482 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1857c502-6dc8-479e-810a-7b83480266f0 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:52.294302 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-1857c502-6dc8-479e-810a-7b83480266f0 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "POST /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.030266 Jun 23 11:54:52.294948 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 533/1050] 10.222.0.13 () {62 vars in 1363 bytes} [Thu Jun 23 11:54:51 2022] POST /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143/os-volume_attachments => generated 188 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 11:54:52.411102 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-5252f5bb-e967-4b14-acd8-e3b17428ca5c tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:52.411598 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-5252f5bb-e967-4b14-acd8-e3b17428ca5c tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:52.418644 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-5252f5bb-e967-4b14-acd8-e3b17428ca5c tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:52.419093 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-5252f5bb-e967-4b14-acd8-e3b17428ca5c tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:52.419844 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-5252f5bb-e967-4b14-acd8-e3b17428ca5c tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:52.420277 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-5252f5bb-e967-4b14-acd8-e3b17428ca5c tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:52.952945 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:54:53.048067 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-5252f5bb-e967-4b14-acd8-e3b17428ca5c tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "DELETE /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143/os-volume_attachments/65e56853-c870-4e48-ac0f-109d28a59058" status: 202 len: 0 microversion: 2.20 time: 0.640939 Jun 23 11:54:53.048660 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 518/1051] 10.222.0.13 () {60 vars in 1456 bytes} [Thu Jun 23 11:54:52 2022] DELETE /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143/os-volume_attachments/65e56853-c870-4e48-ac0f-109d28a59058 => generated 0 bytes in 642 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 23 11:54:53.104689 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-e1ea33c1-9dc4-47d5-a42a-15afe9960ff9 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:54:53.105256 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-e1ea33c1-9dc4-47d5-a42a-15afe9960ff9 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:53.111636 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-e1ea33c1-9dc4-47d5-a42a-15afe9960ff9 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:53.112079 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-e1ea33c1-9dc4-47d5-a42a-15afe9960ff9 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:53.112826 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-e1ea33c1-9dc4-47d5-a42a-15afe9960ff9 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:53.113252 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-e1ea33c1-9dc4-47d5-a42a-15afe9960ff9 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:53.232613 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=7,nova_cell1:INSERT=5 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:54:53.321471 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-e1ea33c1-9dc4-47d5-a42a-15afe9960ff9 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "POST /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143/action" status: 202 len: 0 microversion: 2.20 time: 0.220131 Jun 23 11:54:53.322871 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 534/1052] 10.222.0.13 () {62 vars in 1318 bytes} [Thu Jun 23 11:54:53 2022] POST /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 23 11:54:53.331394 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-a4313554-fc74-4a8c-a63a-fbe7cb389694 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:53.331996 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-a4313554-fc74-4a8c-a63a-fbe7cb389694 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:53.333816 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_api:SELECT=74 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:54:53.339559 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-a4313554-fc74-4a8c-a63a-fbe7cb389694 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:53.340007 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-a4313554-fc74-4a8c-a63a-fbe7cb389694 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:53.340789 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-a4313554-fc74-4a8c-a63a-fbe7cb389694 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:53.341207 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-a4313554-fc74-4a8c-a63a-fbe7cb389694 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:53.479047 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-a4313554-fc74-4a8c-a63a-fbe7cb389694 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:53.494955 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-a4313554-fc74-4a8c-a63a-fbe7cb389694 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:53.496570 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-a4313554-fc74-4a8c-a63a-fbe7cb389694 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:53.497829 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-a4313554-fc74-4a8c-a63a-fbe7cb389694 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143" status: 200 len: 1674 microversion: 2.20 time: 0.170711 Jun 23 11:54:53.508701 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 519/1053] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:54:53 2022] GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 => generated 1674 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:54:54.517414 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-388aee47-cdb9-40dc-a4eb-3de48f2a4fa4 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:54.520133 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-388aee47-cdb9-40dc-a4eb-3de48f2a4fa4 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:54.525392 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-388aee47-cdb9-40dc-a4eb-3de48f2a4fa4 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:54.525847 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-388aee47-cdb9-40dc-a4eb-3de48f2a4fa4 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:54.526644 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-388aee47-cdb9-40dc-a4eb-3de48f2a4fa4 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:54.527079 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-388aee47-cdb9-40dc-a4eb-3de48f2a4fa4 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:54.674358 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-388aee47-cdb9-40dc-a4eb-3de48f2a4fa4 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:54.683378 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-388aee47-cdb9-40dc-a4eb-3de48f2a4fa4 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:54.684801 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-388aee47-cdb9-40dc-a4eb-3de48f2a4fa4 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:54.685959 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-388aee47-cdb9-40dc-a4eb-3de48f2a4fa4 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143" status: 200 len: 1674 microversion: 2.20 time: 0.173695 Jun 23 11:54:54.686520 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 535/1054] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:54:54 2022] GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 => generated 1674 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:54:55.036451 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-451944f6-0cd9-4dd4-b60e-bd7c34a89e75 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:55.037397 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-451944f6-0cd9-4dd4-b60e-bd7c34a89e75 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: f0c76b74-bb63-4f9a-aede-52182140750b] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:55.044607 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-451944f6-0cd9-4dd4-b60e-bd7c34a89e75 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:55.047908 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-451944f6-0cd9-4dd4-b60e-bd7c34a89e75 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:55.047908 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-451944f6-0cd9-4dd4-b60e-bd7c34a89e75 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:55.047908 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-451944f6-0cd9-4dd4-b60e-bd7c34a89e75 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:55.076090 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-451944f6-0cd9-4dd4-b60e-bd7c34a89e75 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/f0c76b74-bb63-4f9a-aede-52182140750b/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043945 Jun 23 11:54:55.076641 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 520/1055] 10.222.0.13 () {58 vars in 1301 bytes} [Thu Jun 23 11:54:55 2022] GET /compute/v2.1/servers/f0c76b74-bb63-4f9a-aede-52182140750b/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:54:55.216336 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-0e6cf2d7-25d4-4832-b53d-6439033caf4b tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:55.216754 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-0e6cf2d7-25d4-4832-b53d-6439033caf4b tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: f0c76b74-bb63-4f9a-aede-52182140750b] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:55.218703 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_api:SELECT=46 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:54:55.223439 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-0e6cf2d7-25d4-4832-b53d-6439033caf4b tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:55.223884 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-0e6cf2d7-25d4-4832-b53d-6439033caf4b tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:55.224633 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-0e6cf2d7-25d4-4832-b53d-6439033caf4b tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:55.225060 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-0e6cf2d7-25d4-4832-b53d-6439033caf4b tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:55.255547 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-0e6cf2d7-25d4-4832-b53d-6439033caf4b tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/f0c76b74-bb63-4f9a-aede-52182140750b/os-volume_attachments/1fb2618e-d788-4fb1-96e2-6478a7bb4136" status: 200 len: 194 microversion: 2.1 time: 0.043229 Jun 23 11:54:55.256118 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 536/1056] 10.222.0.13 () {58 vars in 1412 bytes} [Thu Jun 23 11:54:55 2022] GET /compute/v2.1/servers/f0c76b74-bb63-4f9a-aede-52182140750b/os-volume_attachments/1fb2618e-d788-4fb1-96e2-6478a7bb4136 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:54:55.266925 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-35144da5-b7c4-4a57-ba9c-2ef32f899459 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:55.267453 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-35144da5-b7c4-4a57-ba9c-2ef32f899459 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: f0c76b74-bb63-4f9a-aede-52182140750b] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:55.273544 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-35144da5-b7c4-4a57-ba9c-2ef32f899459 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:55.273993 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-35144da5-b7c4-4a57-ba9c-2ef32f899459 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:55.274778 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-35144da5-b7c4-4a57-ba9c-2ef32f899459 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:55.275219 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-35144da5-b7c4-4a57-ba9c-2ef32f899459 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:55.355668 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.objects.instance [None req-35144da5-b7c4-4a57-ba9c-2ef32f899459 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lazy-loading 'services' on Instance uuid f0c76b74-bb63-4f9a-aede-52182140750b {{(pid=124669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:54:55.540675 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-35144da5-b7c4-4a57-ba9c-2ef32f899459 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "DELETE /compute/v2.1/servers/f0c76b74-bb63-4f9a-aede-52182140750b/os-volume_attachments/1fb2618e-d788-4fb1-96e2-6478a7bb4136" status: 202 len: 0 microversion: 2.1 time: 0.277695 Jun 23 11:54:55.541409 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 521/1057] 10.222.0.13 () {58 vars in 1415 bytes} [Thu Jun 23 11:54:55 2022] DELETE /compute/v2.1/servers/f0c76b74-bb63-4f9a-aede-52182140750b/os-volume_attachments/1fb2618e-d788-4fb1-96e2-6478a7bb4136 => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 11:54:55.705692 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-33c8fee7-596c-4351-b8bd-2d7251da5e7f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:55.706914 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-33c8fee7-596c-4351-b8bd-2d7251da5e7f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:55.714961 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-33c8fee7-596c-4351-b8bd-2d7251da5e7f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:55.715741 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-33c8fee7-596c-4351-b8bd-2d7251da5e7f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:55.716518 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-33c8fee7-596c-4351-b8bd-2d7251da5e7f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:55.717113 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-33c8fee7-596c-4351-b8bd-2d7251da5e7f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:55.934046 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-33c8fee7-596c-4351-b8bd-2d7251da5e7f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:55.939707 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-33c8fee7-596c-4351-b8bd-2d7251da5e7f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:55.941230 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-33c8fee7-596c-4351-b8bd-2d7251da5e7f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:55.942391 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-33c8fee7-596c-4351-b8bd-2d7251da5e7f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143" status: 200 len: 1732 microversion: 2.20 time: 0.241428 Jun 23 11:54:55.942972 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 537/1058] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:54:55 2022] GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 => generated 1732 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:54:56.964099 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-940a1966-0529-4e1f-a330-940681b6f6c8 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:56.964763 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-940a1966-0529-4e1f-a330-940681b6f6c8 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:56.971671 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-940a1966-0529-4e1f-a330-940681b6f6c8 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:56.972121 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-940a1966-0529-4e1f-a330-940681b6f6c8 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:56.972984 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-940a1966-0529-4e1f-a330-940681b6f6c8 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:56.973599 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-940a1966-0529-4e1f-a330-940681b6f6c8 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:57.112779 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-940a1966-0529-4e1f-a330-940681b6f6c8 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:57.122330 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-940a1966-0529-4e1f-a330-940681b6f6c8 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:57.123870 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-940a1966-0529-4e1f-a330-940681b6f6c8 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:57.125110 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-940a1966-0529-4e1f-a330-940681b6f6c8 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143" status: 200 len: 1732 microversion: 2.20 time: 0.166379 Jun 23 11:54:57.125662 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 522/1059] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:54:56 2022] GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 => generated 1732 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:54:58.143024 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-9ffc1e32-2e0c-4c2e-bac0-5c3683773670 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:58.143640 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-9ffc1e32-2e0c-4c2e-bac0-5c3683773670 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:58.145962 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_cell0:SELECT=2 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:54:58.151105 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-9ffc1e32-2e0c-4c2e-bac0-5c3683773670 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:58.151559 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-9ffc1e32-2e0c-4c2e-bac0-5c3683773670 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:58.152322 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-9ffc1e32-2e0c-4c2e-bac0-5c3683773670 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:58.152756 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-9ffc1e32-2e0c-4c2e-bac0-5c3683773670 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:58.286069 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-9ffc1e32-2e0c-4c2e-bac0-5c3683773670 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:58.295048 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-9ffc1e32-2e0c-4c2e-bac0-5c3683773670 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:58.296555 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-9ffc1e32-2e0c-4c2e-bac0-5c3683773670 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:58.297702 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-9ffc1e32-2e0c-4c2e-bac0-5c3683773670 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143" status: 200 len: 1732 microversion: 2.20 time: 0.158560 Jun 23 11:54:58.298247 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 538/1060] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:54:58 2022] GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 => generated 1732 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:54:59.316060 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-95df7394-7b4d-4572-bd0f-64f3d9122b3e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:59.316674 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-95df7394-7b4d-4572-bd0f-64f3d9122b3e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:59.325187 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-95df7394-7b4d-4572-bd0f-64f3d9122b3e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:59.325632 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-95df7394-7b4d-4572-bd0f-64f3d9122b3e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:59.326409 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-95df7394-7b4d-4572-bd0f-64f3d9122b3e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:59.326878 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-95df7394-7b4d-4572-bd0f-64f3d9122b3e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:59.465624 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-95df7394-7b4d-4572-bd0f-64f3d9122b3e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:59.473878 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-95df7394-7b4d-4572-bd0f-64f3d9122b3e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:59.475416 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-95df7394-7b4d-4572-bd0f-64f3d9122b3e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:59.477309 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-95df7394-7b4d-4572-bd0f-64f3d9122b3e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143" status: 200 len: 1732 microversion: 2.20 time: 0.165080 Jun 23 11:54:59.478278 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 523/1061] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:54:59 2022] GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 => generated 1732 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:55:00.495387 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-fd6e2c17-980b-4317-895f-c1a65fddcb74 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:00.496654 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-fd6e2c17-980b-4317-895f-c1a65fddcb74 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:00.504111 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-fd6e2c17-980b-4317-895f-c1a65fddcb74 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:00.504648 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-fd6e2c17-980b-4317-895f-c1a65fddcb74 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:00.505664 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-fd6e2c17-980b-4317-895f-c1a65fddcb74 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:00.506323 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-fd6e2c17-980b-4317-895f-c1a65fddcb74 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:00.611377 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-227270fb-e4dd-4e05-9eea-0ab384d94f24 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:00.611952 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-227270fb-e4dd-4e05-9eea-0ab384d94f24 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 6e9aaa29-4417-4225-b320-0f38cd075e59] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:00.619892 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-227270fb-e4dd-4e05-9eea-0ab384d94f24 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:00.620091 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-227270fb-e4dd-4e05-9eea-0ab384d94f24 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:00.621496 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-227270fb-e4dd-4e05-9eea-0ab384d94f24 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:00.621873 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-227270fb-e4dd-4e05-9eea-0ab384d94f24 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:00.641588 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-fd6e2c17-980b-4317-895f-c1a65fddcb74 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:00.659243 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-227270fb-e4dd-4e05-9eea-0ab384d94f24 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/6e9aaa29-4417-4225-b320-0f38cd075e59/ips" status: 200 len: 150 microversion: 2.1 time: 0.051419 Jun 23 11:55:00.659466 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-fd6e2c17-980b-4317-895f-c1a65fddcb74 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:00.659942 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 524/1062] 10.222.0.13 () {58 vars in 1247 bytes} [Thu Jun 23 11:55:00 2022] GET /compute/v2.1/servers/6e9aaa29-4417-4225-b320-0f38cd075e59/ips => generated 150 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:55:00.660806 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-fd6e2c17-980b-4317-895f-c1a65fddcb74 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:00.662229 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-fd6e2c17-980b-4317-895f-c1a65fddcb74 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143" status: 200 len: 1732 microversion: 2.20 time: 0.171021 Jun 23 11:55:00.667797 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 539/1063] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:55:00 2022] GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 => generated 1732 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:55:01.685844 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-98fb5ed4-7d8c-4adc-9ed0-50b070d54c69 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:01.686461 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-98fb5ed4-7d8c-4adc-9ed0-50b070d54c69 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:01.692660 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-98fb5ed4-7d8c-4adc-9ed0-50b070d54c69 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:01.693096 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-98fb5ed4-7d8c-4adc-9ed0-50b070d54c69 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:01.696191 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-98fb5ed4-7d8c-4adc-9ed0-50b070d54c69 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:01.696191 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-98fb5ed4-7d8c-4adc-9ed0-50b070d54c69 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:01.837277 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-98fb5ed4-7d8c-4adc-9ed0-50b070d54c69 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:01.845767 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-98fb5ed4-7d8c-4adc-9ed0-50b070d54c69 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:01.847316 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-98fb5ed4-7d8c-4adc-9ed0-50b070d54c69 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:01.848501 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-98fb5ed4-7d8c-4adc-9ed0-50b070d54c69 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143" status: 200 len: 1732 microversion: 2.20 time: 0.166619 Jun 23 11:55:01.849057 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 525/1064] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:55:01 2022] GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 => generated 1732 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:55:02.869075 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-4fc1b137-400b-4bde-aad3-d21c696d6629 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:02.869709 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-4fc1b137-400b-4bde-aad3-d21c696d6629 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:02.876566 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-4fc1b137-400b-4bde-aad3-d21c696d6629 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:02.877009 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-4fc1b137-400b-4bde-aad3-d21c696d6629 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:02.877764 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-4fc1b137-400b-4bde-aad3-d21c696d6629 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:02.878193 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-4fc1b137-400b-4bde-aad3-d21c696d6629 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:03.018604 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-4fc1b137-400b-4bde-aad3-d21c696d6629 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:03.027216 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-4fc1b137-400b-4bde-aad3-d21c696d6629 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:03.028796 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-4fc1b137-400b-4bde-aad3-d21c696d6629 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:03.030121 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-4fc1b137-400b-4bde-aad3-d21c696d6629 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143" status: 200 len: 1732 microversion: 2.20 time: 0.166272 Jun 23 11:55:03.030760 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 540/1065] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:55:02 2022] GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 => generated 1732 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:55:04.048803 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-922e30dc-704f-49ee-8504-aa47c670dbbb tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:04.049371 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-922e30dc-704f-49ee-8504-aa47c670dbbb tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:04.063978 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-922e30dc-704f-49ee-8504-aa47c670dbbb tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:04.063978 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-922e30dc-704f-49ee-8504-aa47c670dbbb tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:04.063978 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-922e30dc-704f-49ee-8504-aa47c670dbbb tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:04.063978 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-922e30dc-704f-49ee-8504-aa47c670dbbb tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:04.073257 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-1420c04a-87bc-4745-bf53-564a881c6335 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ba179f75-08fd-48c5-a84d-1422624d2a91"}} {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:55:04.074558 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-1420c04a-87bc-4745-bf53-564a881c6335 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 6e9aaa29-4417-4225-b320-0f38cd075e59] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:04.081149 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1420c04a-87bc-4745-bf53-564a881c6335 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:04.081607 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1420c04a-87bc-4745-bf53-564a881c6335 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:04.082508 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1420c04a-87bc-4745-bf53-564a881c6335 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:04.083413 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1420c04a-87bc-4745-bf53-564a881c6335 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:04.219466 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-922e30dc-704f-49ee-8504-aa47c670dbbb tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:04.229176 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-922e30dc-704f-49ee-8504-aa47c670dbbb tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:04.230937 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-922e30dc-704f-49ee-8504-aa47c670dbbb tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:04.243250 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-922e30dc-704f-49ee-8504-aa47c670dbbb tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143" status: 200 len: 1732 microversion: 2.20 time: 0.187427 Jun 23 11:55:04.243250 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 526/1066] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:55:04 2022] GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 => generated 1732 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:55:05.251028 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-aecf9bdc-57eb-4155-a647-7a6a8fed3085 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:05.251689 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-aecf9bdc-57eb-4155-a647-7a6a8fed3085 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:05.258351 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-aecf9bdc-57eb-4155-a647-7a6a8fed3085 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:05.259936 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-aecf9bdc-57eb-4155-a647-7a6a8fed3085 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:05.260741 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-aecf9bdc-57eb-4155-a647-7a6a8fed3085 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:05.261132 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-aecf9bdc-57eb-4155-a647-7a6a8fed3085 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:05.403388 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-aecf9bdc-57eb-4155-a647-7a6a8fed3085 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:05.411330 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-aecf9bdc-57eb-4155-a647-7a6a8fed3085 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:05.412864 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-aecf9bdc-57eb-4155-a647-7a6a8fed3085 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:05.414033 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-aecf9bdc-57eb-4155-a647-7a6a8fed3085 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143" status: 200 len: 1732 microversion: 2.20 time: 0.167052 Jun 23 11:55:05.425418 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 527/1067] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:55:05 2022] GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 => generated 1732 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:55:06.434232 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-5a3931da-91ca-4e8c-ad5f-08e0fcae748a tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:06.434882 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-5a3931da-91ca-4e8c-ad5f-08e0fcae748a tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:06.441272 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-5a3931da-91ca-4e8c-ad5f-08e0fcae748a tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:06.441727 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-5a3931da-91ca-4e8c-ad5f-08e0fcae748a tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:06.445477 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-5a3931da-91ca-4e8c-ad5f-08e0fcae748a tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:06.445477 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-5a3931da-91ca-4e8c-ad5f-08e0fcae748a tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:06.584810 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-5a3931da-91ca-4e8c-ad5f-08e0fcae748a tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:06.594591 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-5a3931da-91ca-4e8c-ad5f-08e0fcae748a tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:06.596107 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-5a3931da-91ca-4e8c-ad5f-08e0fcae748a tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:06.597278 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-5a3931da-91ca-4e8c-ad5f-08e0fcae748a tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143" status: 200 len: 1732 microversion: 2.20 time: 0.167083 Jun 23 11:55:06.597834 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 528/1068] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:55:06 2022] GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 => generated 1732 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:55:07.615567 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-88de5fbc-c83e-43ca-86cb-be4ccec39fb3 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:07.616230 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-88de5fbc-c83e-43ca-86cb-be4ccec39fb3 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:07.622804 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-88de5fbc-c83e-43ca-86cb-be4ccec39fb3 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:07.623252 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-88de5fbc-c83e-43ca-86cb-be4ccec39fb3 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:07.624003 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-88de5fbc-c83e-43ca-86cb-be4ccec39fb3 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:07.624432 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-88de5fbc-c83e-43ca-86cb-be4ccec39fb3 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:07.756563 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-88de5fbc-c83e-43ca-86cb-be4ccec39fb3 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:07.765160 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-88de5fbc-c83e-43ca-86cb-be4ccec39fb3 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:07.766683 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-88de5fbc-c83e-43ca-86cb-be4ccec39fb3 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:07.767841 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-88de5fbc-c83e-43ca-86cb-be4ccec39fb3 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143" status: 200 len: 1732 microversion: 2.20 time: 0.156164 Jun 23 11:55:07.768389 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 529/1069] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:55:07 2022] GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:55:08.786458 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-0ecb7ca3-8bab-4010-a51c-eb1efeaeed11 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:08.787141 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-0ecb7ca3-8bab-4010-a51c-eb1efeaeed11 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:08.794160 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-0ecb7ca3-8bab-4010-a51c-eb1efeaeed11 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:08.794675 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-0ecb7ca3-8bab-4010-a51c-eb1efeaeed11 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:08.795434 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-0ecb7ca3-8bab-4010-a51c-eb1efeaeed11 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:08.795871 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-0ecb7ca3-8bab-4010-a51c-eb1efeaeed11 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:08.928380 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-0ecb7ca3-8bab-4010-a51c-eb1efeaeed11 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:08.931713 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-0ecb7ca3-8bab-4010-a51c-eb1efeaeed11 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:08.933247 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-0ecb7ca3-8bab-4010-a51c-eb1efeaeed11 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:08.934403 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-0ecb7ca3-8bab-4010-a51c-eb1efeaeed11 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143" status: 200 len: 1732 microversion: 2.20 time: 0.151856 Jun 23 11:55:08.934987 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 530/1070] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:55:08 2022] GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:55:09.953041 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-b60816d4-695e-4682-9055-c3daf86c5e1f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:09.953702 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-b60816d4-695e-4682-9055-c3daf86c5e1f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:09.960104 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-b60816d4-695e-4682-9055-c3daf86c5e1f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:09.960587 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-b60816d4-695e-4682-9055-c3daf86c5e1f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:09.961369 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-b60816d4-695e-4682-9055-c3daf86c5e1f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:09.962486 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-b60816d4-695e-4682-9055-c3daf86c5e1f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:10.092367 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-b60816d4-695e-4682-9055-c3daf86c5e1f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:10.100218 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-b60816d4-695e-4682-9055-c3daf86c5e1f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:10.101705 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-b60816d4-695e-4682-9055-c3daf86c5e1f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:10.103594 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-b60816d4-695e-4682-9055-c3daf86c5e1f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143" status: 200 len: 1732 microversion: 2.20 time: 0.154237 Jun 23 11:55:10.104148 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 531/1071] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:55:09 2022] GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:55:11.121505 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-6a4c3e4c-92a8-41f5-8930-552a511c8c7d tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:11.122145 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-6a4c3e4c-92a8-41f5-8930-552a511c8c7d tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:11.128497 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-6a4c3e4c-92a8-41f5-8930-552a511c8c7d tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:11.128943 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-6a4c3e4c-92a8-41f5-8930-552a511c8c7d tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:11.129690 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-6a4c3e4c-92a8-41f5-8930-552a511c8c7d tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:11.130119 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-6a4c3e4c-92a8-41f5-8930-552a511c8c7d tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:11.260147 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-6a4c3e4c-92a8-41f5-8930-552a511c8c7d tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:11.267958 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-6a4c3e4c-92a8-41f5-8930-552a511c8c7d tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:11.269442 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-6a4c3e4c-92a8-41f5-8930-552a511c8c7d tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:11.270606 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-6a4c3e4c-92a8-41f5-8930-552a511c8c7d tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143" status: 200 len: 1732 microversion: 2.20 time: 0.153268 Jun 23 11:55:11.271155 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 532/1072] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:55:11 2022] GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:55:12.288798 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-8c99adee-dbda-4a00-b290-af1667b4206f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:12.289436 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-8c99adee-dbda-4a00-b290-af1667b4206f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:12.296381 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-8c99adee-dbda-4a00-b290-af1667b4206f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:12.296833 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-8c99adee-dbda-4a00-b290-af1667b4206f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:12.297599 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-8c99adee-dbda-4a00-b290-af1667b4206f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:12.298022 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-8c99adee-dbda-4a00-b290-af1667b4206f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:12.424820 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-8c99adee-dbda-4a00-b290-af1667b4206f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:12.433536 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-8c99adee-dbda-4a00-b290-af1667b4206f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:12.435061 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-8c99adee-dbda-4a00-b290-af1667b4206f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:12.436208 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-8c99adee-dbda-4a00-b290-af1667b4206f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143" status: 200 len: 1732 microversion: 2.20 time: 0.151309 Jun 23 11:55:12.436757 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 533/1073] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:55:12 2022] GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 => generated 1732 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:55:13.454280 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-633222c6-0bb1-4ba7-8f00-ec2a8eef6197 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:13.454976 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-633222c6-0bb1-4ba7-8f00-ec2a8eef6197 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:13.461293 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-633222c6-0bb1-4ba7-8f00-ec2a8eef6197 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:13.461737 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-633222c6-0bb1-4ba7-8f00-ec2a8eef6197 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:13.462486 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-633222c6-0bb1-4ba7-8f00-ec2a8eef6197 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:13.462940 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-633222c6-0bb1-4ba7-8f00-ec2a8eef6197 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:13.597769 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-633222c6-0bb1-4ba7-8f00-ec2a8eef6197 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:13.606130 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-633222c6-0bb1-4ba7-8f00-ec2a8eef6197 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:13.608393 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-633222c6-0bb1-4ba7-8f00-ec2a8eef6197 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:13.609543 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-633222c6-0bb1-4ba7-8f00-ec2a8eef6197 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143" status: 200 len: 1732 microversion: 2.20 time: 0.160245 Jun 23 11:55:13.610099 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 534/1074] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:55:13 2022] GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 => generated 1732 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:55:14.080591 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_api:SELECT=11 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:55:14.435795 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-1420c04a-87bc-4745-bf53-564a881c6335 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "POST /compute/v2.1/servers/6e9aaa29-4417-4225-b320-0f38cd075e59/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 10.368570 Jun 23 11:55:14.436619 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 541/1075] 10.222.0.13 () {60 vars in 1322 bytes} [Thu Jun 23 11:55:04 2022] POST /compute/v2.1/servers/6e9aaa29-4417-4225-b320-0f38cd075e59/os-volume_attachments => generated 194 bytes in 10370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:55:14.629151 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-49833ca2-13a1-4c9d-b767-7c4979f8efeb tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:14.635204 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-49833ca2-13a1-4c9d-b767-7c4979f8efeb tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:14.640708 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-49833ca2-13a1-4c9d-b767-7c4979f8efeb tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:14.641181 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-49833ca2-13a1-4c9d-b767-7c4979f8efeb tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:14.642070 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-49833ca2-13a1-4c9d-b767-7c4979f8efeb tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:14.642515 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-49833ca2-13a1-4c9d-b767-7c4979f8efeb tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:14.648177 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:55:14.791200 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-49833ca2-13a1-4c9d-b767-7c4979f8efeb tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:14.801130 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-49833ca2-13a1-4c9d-b767-7c4979f8efeb tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:14.802774 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-49833ca2-13a1-4c9d-b767-7c4979f8efeb tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:14.806796 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-49833ca2-13a1-4c9d-b767-7c4979f8efeb tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143" status: 200 len: 1732 microversion: 2.20 time: 0.180587 Jun 23 11:55:14.806796 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 535/1076] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:55:14 2022] GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 => generated 1732 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:55:15.542474 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-a8ef5ee3-beec-4406-9ef0-0b3359116e81 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:15.543397 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-a8ef5ee3-beec-4406-9ef0-0b3359116e81 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] [instance: 06c1d69d-fafe-412e-ac84-49c12c6029d0] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:15.550587 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a8ef5ee3-beec-4406-9ef0-0b3359116e81 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:15.551114 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a8ef5ee3-beec-4406-9ef0-0b3359116e81 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:15.551891 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a8ef5ee3-beec-4406-9ef0-0b3359116e81 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:15.552327 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a8ef5ee3-beec-4406-9ef0-0b3359116e81 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:15.683497 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-a8ef5ee3-beec-4406-9ef0-0b3359116e81 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a4c8e15cd44904805c2519c4b6864a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a1542e108d4e3e85fe5525a7e331d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:15.692387 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-a8ef5ee3-beec-4406-9ef0-0b3359116e81 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] 10.222.0.13 "GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0" status: 200 len: 1594 microversion: 2.1 time: 0.154541 Jun 23 11:55:15.693100 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 542/1077] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:15 2022] GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0 => generated 1594 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:15.823256 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-49792e98-f32b-4b03-bfdd-5b8ee345806d tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:15.823917 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-49792e98-f32b-4b03-bfdd-5b8ee345806d tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:15.831832 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-49792e98-f32b-4b03-bfdd-5b8ee345806d tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:15.832274 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-49792e98-f32b-4b03-bfdd-5b8ee345806d tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:15.833036 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-49792e98-f32b-4b03-bfdd-5b8ee345806d tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:15.833470 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-49792e98-f32b-4b03-bfdd-5b8ee345806d tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:16.286322 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-49792e98-f32b-4b03-bfdd-5b8ee345806d tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:16.294357 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-49792e98-f32b-4b03-bfdd-5b8ee345806d tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:16.295875 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-49792e98-f32b-4b03-bfdd-5b8ee345806d tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:16.297030 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-49792e98-f32b-4b03-bfdd-5b8ee345806d tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143" status: 200 len: 1732 microversion: 2.20 time: 0.477894 Jun 23 11:55:16.297584 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 536/1078] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:55:15 2022] GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 => generated 1732 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:55:16.769197 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-368727f3-a8bb-46cd-853a-ac627bdbb684 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:16.770694 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-368727f3-a8bb-46cd-853a-ac627bdbb684 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: f0c76b74-bb63-4f9a-aede-52182140750b] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:16.779485 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-368727f3-a8bb-46cd-853a-ac627bdbb684 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:16.781160 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-368727f3-a8bb-46cd-853a-ac627bdbb684 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:16.782273 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-368727f3-a8bb-46cd-853a-ac627bdbb684 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:16.782905 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-368727f3-a8bb-46cd-853a-ac627bdbb684 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:16.820501 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-368727f3-a8bb-46cd-853a-ac627bdbb684 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/f0c76b74-bb63-4f9a-aede-52182140750b/os-volume_attachments/555a71f8-daca-40a5-a305-82a5b277c285" status: 200 len: 194 microversion: 2.1 time: 0.056873 Jun 23 11:55:16.821083 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 543/1079] 10.222.0.13 () {58 vars in 1412 bytes} [Thu Jun 23 11:55:16 2022] GET /compute/v2.1/servers/f0c76b74-bb63-4f9a-aede-52182140750b/os-volume_attachments/555a71f8-daca-40a5-a305-82a5b277c285 => generated 194 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:55:16.831731 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-f4257279-c41c-4498-9a8f-14cc18ab2f54 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:16.832467 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-f4257279-c41c-4498-9a8f-14cc18ab2f54 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: f0c76b74-bb63-4f9a-aede-52182140750b] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:16.839081 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-f4257279-c41c-4498-9a8f-14cc18ab2f54 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:16.839676 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-f4257279-c41c-4498-9a8f-14cc18ab2f54 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:16.840538 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-f4257279-c41c-4498-9a8f-14cc18ab2f54 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:16.841068 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-f4257279-c41c-4498-9a8f-14cc18ab2f54 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:16.901712 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [req-23d3fe5d-92c0-4c16-924a-580b63c39567 req-6dc868b4-a1b9-499d-b0c4-63d47dfe346e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e51258d-c99d-4d15-8463-c699bcfa9143", "name": "network-vif-plugged", "status": "completed", "tag": "2fc09618-5ffd-4c12-8072-c756814d925d"}]} {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:55:16.913663 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-23d3fe5d-92c0-4c16-924a-580b63c39567 req-6dc868b4-a1b9-499d-b0c4-63d47dfe346e service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:16.914480 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-23d3fe5d-92c0-4c16-924a-580b63c39567 req-6dc868b4-a1b9-499d-b0c4-63d47dfe346e service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:16.929518 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.compute.server_external_events [req-23d3fe5d-92c0-4c16-924a-580b63c39567 req-6dc868b4-a1b9-499d-b0c4-63d47dfe346e service nova] Creating event network-vif-plugged:2fc09618-5ffd-4c12-8072-c756814d925d for instance 1e51258d-c99d-4d15-8463-c699bcfa9143 on hv-cinder-82099 Jun 23 11:55:16.939683 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.objects.instance [None req-f4257279-c41c-4498-9a8f-14cc18ab2f54 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lazy-loading 'services' on Instance uuid f0c76b74-bb63-4f9a-aede-52182140750b {{(pid=124669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:55:16.940369 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [req-23d3fe5d-92c0-4c16-924a-580b63c39567 req-6dc868b4-a1b9-499d-b0c4-63d47dfe346e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042493 Jun 23 11:55:16.941151 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 544/1080] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:55:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:55:17.163119 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-f4257279-c41c-4498-9a8f-14cc18ab2f54 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "DELETE /compute/v2.1/servers/f0c76b74-bb63-4f9a-aede-52182140750b/os-volume_attachments/555a71f8-daca-40a5-a305-82a5b277c285" status: 202 len: 0 microversion: 2.1 time: 0.335705 Jun 23 11:55:17.163888 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 537/1081] 10.222.0.13 () {58 vars in 1415 bytes} [Thu Jun 23 11:55:16 2022] DELETE /compute/v2.1/servers/f0c76b74-bb63-4f9a-aede-52182140750b/os-volume_attachments/555a71f8-daca-40a5-a305-82a5b277c285 => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 11:55:17.316976 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-ae8a570a-cd8e-4764-859d-8cbe122a39ab tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:17.318845 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-ae8a570a-cd8e-4764-859d-8cbe122a39ab tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:17.324074 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-ae8a570a-cd8e-4764-859d-8cbe122a39ab tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:17.324793 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-ae8a570a-cd8e-4764-859d-8cbe122a39ab tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:17.326007 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-ae8a570a-cd8e-4764-859d-8cbe122a39ab tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:17.327282 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-ae8a570a-cd8e-4764-859d-8cbe122a39ab tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:17.534155 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-ae8a570a-cd8e-4764-859d-8cbe122a39ab tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:17.542195 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-ae8a570a-cd8e-4764-859d-8cbe122a39ab tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:17.543837 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-ae8a570a-cd8e-4764-859d-8cbe122a39ab tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:17.545017 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-ae8a570a-cd8e-4764-859d-8cbe122a39ab tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143" status: 200 len: 1732 microversion: 2.20 time: 0.232242 Jun 23 11:55:17.545578 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 545/1082] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:55:17 2022] GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 => generated 1732 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:55:18.166942 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [req-725adf9c-00fd-4a62-92bd-923d458158e9 req-e0e35a3b-9797-4504-9966-6986a4cbf95c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06c1d69d-fafe-412e-ac84-49c12c6029d0", "tag": "2f36a3ef-b1bd-48d9-8060-f3cbb922568c"}]} {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:55:18.177555 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [req-725adf9c-00fd-4a62-92bd-923d458158e9 req-e0e35a3b-9797-4504-9966-6986a4cbf95c service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:18.178271 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [req-725adf9c-00fd-4a62-92bd-923d458158e9 req-e0e35a3b-9797-4504-9966-6986a4cbf95c service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:18.190982 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.compute.server_external_events [req-725adf9c-00fd-4a62-92bd-923d458158e9 req-e0e35a3b-9797-4504-9966-6986a4cbf95c service nova] Creating event network-changed:2f36a3ef-b1bd-48d9-8060-f3cbb922568c for instance 06c1d69d-fafe-412e-ac84-49c12c6029d0 on hv-cinder-82099 Jun 23 11:55:18.195928 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [req-725adf9c-00fd-4a62-92bd-923d458158e9 req-e0e35a3b-9797-4504-9966-6986a4cbf95c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032934 Jun 23 11:55:18.196657 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 538/1083] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:55:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:55:18.563433 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-ec8d8473-33d6-4867-bd06-7c1e8a5b637c tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:18.564190 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-ec8d8473-33d6-4867-bd06-7c1e8a5b637c tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:18.570993 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-ec8d8473-33d6-4867-bd06-7c1e8a5b637c tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:18.571452 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-ec8d8473-33d6-4867-bd06-7c1e8a5b637c tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:18.572200 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-ec8d8473-33d6-4867-bd06-7c1e8a5b637c tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:18.572629 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-ec8d8473-33d6-4867-bd06-7c1e8a5b637c tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:18.754704 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-ec8d8473-33d6-4867-bd06-7c1e8a5b637c tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:18.775465 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-ec8d8473-33d6-4867-bd06-7c1e8a5b637c tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:18.778839 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-ec8d8473-33d6-4867-bd06-7c1e8a5b637c tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:18.783115 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-ec8d8473-33d6-4867-bd06-7c1e8a5b637c tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143" status: 200 len: 1732 microversion: 2.20 time: 0.220950 Jun 23 11:55:18.785000 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 546/1084] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:55:18 2022] GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 => generated 1732 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:55:19.802787 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-0b644c80-b458-49e7-9b9f-37c256b3f757 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:19.803481 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-0b644c80-b458-49e7-9b9f-37c256b3f757 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:19.809663 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-0b644c80-b458-49e7-9b9f-37c256b3f757 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:19.816993 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-0b644c80-b458-49e7-9b9f-37c256b3f757 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:19.816993 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-0b644c80-b458-49e7-9b9f-37c256b3f757 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:19.816993 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-0b644c80-b458-49e7-9b9f-37c256b3f757 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:19.981399 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-0b644c80-b458-49e7-9b9f-37c256b3f757 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:19.990110 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-0b644c80-b458-49e7-9b9f-37c256b3f757 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:19.991561 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-0b644c80-b458-49e7-9b9f-37c256b3f757 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:19.992715 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-0b644c80-b458-49e7-9b9f-37c256b3f757 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143" status: 200 len: 1732 microversion: 2.20 time: 0.194794 Jun 23 11:55:19.993260 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 539/1085] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:55:19 2022] GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 => generated 1732 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:55:20.868889 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-3367526a-0dfb-482f-a510-5705d9eb5334 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1170916986"}} {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:55:20.869425 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-3367526a-0dfb-482f-a510-5705d9eb5334 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] [instance: 06c1d69d-fafe-412e-ac84-49c12c6029d0] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:20.877959 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-3367526a-0dfb-482f-a510-5705d9eb5334 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:20.878415 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-3367526a-0dfb-482f-a510-5705d9eb5334 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:20.879216 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-3367526a-0dfb-482f-a510-5705d9eb5334 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:20.879820 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-3367526a-0dfb-482f-a510-5705d9eb5334 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:21.012879 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-f7f4a0e5-9b41-45ca-b232-7b74fa9e8f9f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:21.014119 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-f7f4a0e5-9b41-45ca-b232-7b74fa9e8f9f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:21.023089 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-f7f4a0e5-9b41-45ca-b232-7b74fa9e8f9f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:21.023631 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-f7f4a0e5-9b41-45ca-b232-7b74fa9e8f9f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:21.024406 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-f7f4a0e5-9b41-45ca-b232-7b74fa9e8f9f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:21.024516 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.network.security_group_api [None req-3367526a-0dfb-482f-a510-5705d9eb5334 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Adding security group 06864c33-c25d-44f1-b654-eec1052dc21d to port 2f36a3ef-b1bd-48d9-8060-f3cbb922568c Jun 23 11:55:21.024845 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-f7f4a0e5-9b41-45ca-b232-7b74fa9e8f9f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:21.252338 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-f7f4a0e5-9b41-45ca-b232-7b74fa9e8f9f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:21.262430 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-f7f4a0e5-9b41-45ca-b232-7b74fa9e8f9f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:21.263956 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-f7f4a0e5-9b41-45ca-b232-7b74fa9e8f9f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:21.267096 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-f7f4a0e5-9b41-45ca-b232-7b74fa9e8f9f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143" status: 200 len: 1732 microversion: 2.20 time: 0.260535 Jun 23 11:55:21.268166 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 540/1086] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:55:21 2022] GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 => generated 1732 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:55:21.605654 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-3367526a-0dfb-482f-a510-5705d9eb5334 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] 10.222.0.13 "POST /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0/action" status: 202 len: 0 microversion: 2.1 time: 0.740647 Jun 23 11:55:21.606758 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 547/1087] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Jun 23 11:55:20 2022] POST /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0/action => generated 0 bytes in 742 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 11:55:21.615882 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-e8b275e0-8577-4c96-9a1b-3542c6eb87e9 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:21.616779 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-e8b275e0-8577-4c96-9a1b-3542c6eb87e9 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] [instance: 06c1d69d-fafe-412e-ac84-49c12c6029d0] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:21.617984 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [req-51c50fdd-d5f2-481e-ad7f-cd42bee26e1b req-633e0a4d-eb04-4645-816f-eee95b34488c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06c1d69d-fafe-412e-ac84-49c12c6029d0", "tag": "2f36a3ef-b1bd-48d9-8060-f3cbb922568c"}]} {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:55:21.624389 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-e8b275e0-8577-4c96-9a1b-3542c6eb87e9 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:21.625167 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-e8b275e0-8577-4c96-9a1b-3542c6eb87e9 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:21.626112 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-e8b275e0-8577-4c96-9a1b-3542c6eb87e9 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:21.626772 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-e8b275e0-8577-4c96-9a1b-3542c6eb87e9 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:21.627997 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-51c50fdd-d5f2-481e-ad7f-cd42bee26e1b req-633e0a4d-eb04-4645-816f-eee95b34488c service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:21.628441 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-51c50fdd-d5f2-481e-ad7f-cd42bee26e1b req-633e0a4d-eb04-4645-816f-eee95b34488c service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:21.641424 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.compute.server_external_events [req-51c50fdd-d5f2-481e-ad7f-cd42bee26e1b req-633e0a4d-eb04-4645-816f-eee95b34488c service nova] Creating event network-changed:2f36a3ef-b1bd-48d9-8060-f3cbb922568c for instance 06c1d69d-fafe-412e-ac84-49c12c6029d0 on hv-cinder-82099 Jun 23 11:55:21.647164 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [req-51c50fdd-d5f2-481e-ad7f-cd42bee26e1b req-633e0a4d-eb04-4645-816f-eee95b34488c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032783 Jun 23 11:55:21.648128 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 548/1088] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:55:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:55:21.923843 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-e8b275e0-8577-4c96-9a1b-3542c6eb87e9 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a4c8e15cd44904805c2519c4b6864a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a1542e108d4e3e85fe5525a7e331d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:21.929022 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-e8b275e0-8577-4c96-9a1b-3542c6eb87e9 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] 10.222.0.13 "GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0" status: 200 len: 1759 microversion: 2.1 time: 0.317001 Jun 23 11:55:21.929605 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 541/1089] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:21 2022] GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0 => generated 1759 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:55:22.287522 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-a44cad42-7b2d-46da-a946-fa2bb39d1e4e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:22.288218 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-a44cad42-7b2d-46da-a946-fa2bb39d1e4e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:22.295568 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a44cad42-7b2d-46da-a946-fa2bb39d1e4e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:22.296013 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a44cad42-7b2d-46da-a946-fa2bb39d1e4e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:22.296852 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a44cad42-7b2d-46da-a946-fa2bb39d1e4e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:22.297979 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a44cad42-7b2d-46da-a946-fa2bb39d1e4e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:22.431410 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-a44cad42-7b2d-46da-a946-fa2bb39d1e4e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:22.439297 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-a44cad42-7b2d-46da-a946-fa2bb39d1e4e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:22.440824 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-a44cad42-7b2d-46da-a946-fa2bb39d1e4e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:22.441974 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-a44cad42-7b2d-46da-a946-fa2bb39d1e4e tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143" status: 200 len: 1719 microversion: 2.20 time: 0.159958 Jun 23 11:55:22.442521 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 549/1090] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:55:22 2022] GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 => generated 1719 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:55:24.187054 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-a584294c-6798-42fd-a8d9-7fe34059cba4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:24.188092 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-a584294c-6798-42fd-a8d9-7fe34059cba4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 6e9aaa29-4417-4225-b320-0f38cd075e59] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:24.190048 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_api:SELECT=46 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:55:24.194804 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-a584294c-6798-42fd-a8d9-7fe34059cba4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:24.195255 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-a584294c-6798-42fd-a8d9-7fe34059cba4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:24.196014 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-a584294c-6798-42fd-a8d9-7fe34059cba4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:24.196451 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-a584294c-6798-42fd-a8d9-7fe34059cba4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:24.278366 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.objects.instance [None req-a584294c-6798-42fd-a8d9-7fe34059cba4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lazy-loading 'services' on Instance uuid 6e9aaa29-4417-4225-b320-0f38cd075e59 {{(pid=124669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:55:24.544707 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-a584294c-6798-42fd-a8d9-7fe34059cba4 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "DELETE /compute/v2.1/servers/6e9aaa29-4417-4225-b320-0f38cd075e59/os-volume_attachments/ba179f75-08fd-48c5-a84d-1422624d2a91" status: 202 len: 0 microversion: 2.1 time: 0.361288 Jun 23 11:55:24.545225 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 542/1091] 10.222.0.13 () {58 vars in 1415 bytes} [Thu Jun 23 11:55:24 2022] DELETE /compute/v2.1/servers/6e9aaa29-4417-4225-b320-0f38cd075e59/os-volume_attachments/ba179f75-08fd-48c5-a84d-1422624d2a91 => generated 0 bytes in 363 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 11:55:24.566636 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-8559139b-ac5c-479d-9848-d579866a8ee8 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:24.566636 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-8559139b-ac5c-479d-9848-d579866a8ee8 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 6e9aaa29-4417-4225-b320-0f38cd075e59] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:24.566636 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-8559139b-ac5c-479d-9848-d579866a8ee8 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:24.566636 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-8559139b-ac5c-479d-9848-d579866a8ee8 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:24.567327 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-8559139b-ac5c-479d-9848-d579866a8ee8 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:24.567327 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-8559139b-ac5c-479d-9848-d579866a8ee8 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:24.594147 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-8559139b-ac5c-479d-9848-d579866a8ee8 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/6e9aaa29-4417-4225-b320-0f38cd075e59/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044346 Jun 23 11:55:24.598282 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 550/1092] 10.222.0.13 () {58 vars in 1301 bytes} [Thu Jun 23 11:55:24 2022] GET /compute/v2.1/servers/6e9aaa29-4417-4225-b320-0f38cd075e59/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:55:25.606767 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-dbb8206f-9619-421e-9b42-66972b00d55f tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:25.607976 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-dbb8206f-9619-421e-9b42-66972b00d55f tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 6e9aaa29-4417-4225-b320-0f38cd075e59] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:25.615123 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-dbb8206f-9619-421e-9b42-66972b00d55f tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:25.615589 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-dbb8206f-9619-421e-9b42-66972b00d55f tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:25.616366 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-dbb8206f-9619-421e-9b42-66972b00d55f tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:25.616808 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-dbb8206f-9619-421e-9b42-66972b00d55f tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:25.648296 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-dbb8206f-9619-421e-9b42-66972b00d55f tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/6e9aaa29-4417-4225-b320-0f38cd075e59/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046715 Jun 23 11:55:25.652354 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 543/1093] 10.222.0.13 () {58 vars in 1301 bytes} [Thu Jun 23 11:55:25 2022] GET /compute/v2.1/servers/6e9aaa29-4417-4225-b320-0f38cd075e59/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:55:25.714637 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-ce957adb-d81c-4cf4-8132-76f2321d6264 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:25.715618 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-ce957adb-d81c-4cf4-8132-76f2321d6264 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: f0c76b74-bb63-4f9a-aede-52182140750b] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:25.722436 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-ce957adb-d81c-4cf4-8132-76f2321d6264 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:25.722926 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-ce957adb-d81c-4cf4-8132-76f2321d6264 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:25.723699 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-ce957adb-d81c-4cf4-8132-76f2321d6264 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:25.724141 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-ce957adb-d81c-4cf4-8132-76f2321d6264 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:25.726824 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:55:25.755255 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-ce957adb-d81c-4cf4-8132-76f2321d6264 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/f0c76b74-bb63-4f9a-aede-52182140750b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044672 Jun 23 11:55:25.755800 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 551/1094] 10.222.0.13 () {58 vars in 1301 bytes} [Thu Jun 23 11:55:25 2022] GET /compute/v2.1/servers/f0c76b74-bb63-4f9a-aede-52182140750b/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 11:55:25.857890 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-b7a40683-eca0-4a62-9577-882dd76a6e5c tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:25.858856 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-b7a40683-eca0-4a62-9577-882dd76a6e5c tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: f0c76b74-bb63-4f9a-aede-52182140750b] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:25.865545 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-b7a40683-eca0-4a62-9577-882dd76a6e5c tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:25.865986 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-b7a40683-eca0-4a62-9577-882dd76a6e5c tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:25.866806 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-b7a40683-eca0-4a62-9577-882dd76a6e5c tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:25.867236 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-b7a40683-eca0-4a62-9577-882dd76a6e5c tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:25.896648 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-b7a40683-eca0-4a62-9577-882dd76a6e5c tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/f0c76b74-bb63-4f9a-aede-52182140750b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042881 Jun 23 11:55:25.897196 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 544/1095] 10.222.0.13 () {58 vars in 1301 bytes} [Thu Jun 23 11:55:25 2022] GET /compute/v2.1/servers/f0c76b74-bb63-4f9a-aede-52182140750b/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 11:55:25.955669 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-d3bc31b2-736d-4aa2-a53c-9687090408e5 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:25.956172 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-d3bc31b2-736d-4aa2-a53c-9687090408e5 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: f0c76b74-bb63-4f9a-aede-52182140750b] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:25.963034 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-d3bc31b2-736d-4aa2-a53c-9687090408e5 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:25.963485 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-d3bc31b2-736d-4aa2-a53c-9687090408e5 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:25.964268 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-d3bc31b2-736d-4aa2-a53c-9687090408e5 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:25.964704 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-d3bc31b2-736d-4aa2-a53c-9687090408e5 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:25.990960 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-d3bc31b2-736d-4aa2-a53c-9687090408e5 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: f0c76b74-bb63-4f9a-aede-52182140750b] Going to try to terminate instance {{(pid=124670) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 11:55:26.277247 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-d3bc31b2-736d-4aa2-a53c-9687090408e5 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "DELETE /compute/v2.1/servers/f0c76b74-bb63-4f9a-aede-52182140750b" status: 204 len: 0 microversion: 2.1 time: 0.325157 Jun 23 11:55:26.277834 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 552/1096] 10.222.0.13 () {58 vars in 1238 bytes} [Thu Jun 23 11:55:25 2022] DELETE /compute/v2.1/servers/f0c76b74-bb63-4f9a-aede-52182140750b => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 11:55:26.286869 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-4dd15bc8-75b5-40c6-beeb-ee573200c149 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:26.287476 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-4dd15bc8-75b5-40c6-beeb-ee573200c149 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: f0c76b74-bb63-4f9a-aede-52182140750b] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:26.294150 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-4dd15bc8-75b5-40c6-beeb-ee573200c149 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:26.294751 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-4dd15bc8-75b5-40c6-beeb-ee573200c149 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:26.295516 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-4dd15bc8-75b5-40c6-beeb-ee573200c149 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:26.295959 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-4dd15bc8-75b5-40c6-beeb-ee573200c149 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:26.428031 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-4dd15bc8-75b5-40c6-beeb-ee573200c149 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:26.435844 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-4dd15bc8-75b5-40c6-beeb-ee573200c149 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/f0c76b74-bb63-4f9a-aede-52182140750b" status: 200 len: 1674 microversion: 2.1 time: 0.153063 Jun 23 11:55:26.436343 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 545/1097] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:26 2022] GET /compute/v2.1/servers/f0c76b74-bb63-4f9a-aede-52182140750b => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:55:26.660728 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-b14056ff-82d5-481f-8d05-565c5b9cb1b8 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:26.661750 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-b14056ff-82d5-481f-8d05-565c5b9cb1b8 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 6e9aaa29-4417-4225-b320-0f38cd075e59] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:26.667876 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-b14056ff-82d5-481f-8d05-565c5b9cb1b8 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:26.668318 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-b14056ff-82d5-481f-8d05-565c5b9cb1b8 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:26.669061 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-b14056ff-82d5-481f-8d05-565c5b9cb1b8 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:26.669487 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-b14056ff-82d5-481f-8d05-565c5b9cb1b8 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:26.700569 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-b14056ff-82d5-481f-8d05-565c5b9cb1b8 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/6e9aaa29-4417-4225-b320-0f38cd075e59/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044067 Jun 23 11:55:26.701490 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 553/1098] 10.222.0.13 () {58 vars in 1301 bytes} [Thu Jun 23 11:55:26 2022] GET /compute/v2.1/servers/6e9aaa29-4417-4225-b320-0f38cd075e59/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 23 11:55:26.773539 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-f1a58070-34f5-4b7b-97fb-975cc5703b29 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:26.774649 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-f1a58070-34f5-4b7b-97fb-975cc5703b29 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 6e9aaa29-4417-4225-b320-0f38cd075e59] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:26.781561 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-f1a58070-34f5-4b7b-97fb-975cc5703b29 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:26.782022 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-f1a58070-34f5-4b7b-97fb-975cc5703b29 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:26.782831 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-f1a58070-34f5-4b7b-97fb-975cc5703b29 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:26.783275 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-f1a58070-34f5-4b7b-97fb-975cc5703b29 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:26.808782 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-f1a58070-34f5-4b7b-97fb-975cc5703b29 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 6e9aaa29-4417-4225-b320-0f38cd075e59] Going to try to terminate instance {{(pid=124669) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 11:55:27.059875 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-f1a58070-34f5-4b7b-97fb-975cc5703b29 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "DELETE /compute/v2.1/servers/6e9aaa29-4417-4225-b320-0f38cd075e59" status: 204 len: 0 microversion: 2.1 time: 0.289812 Jun 23 11:55:27.060383 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 546/1099] 10.222.0.13 () {58 vars in 1238 bytes} [Thu Jun 23 11:55:26 2022] DELETE /compute/v2.1/servers/6e9aaa29-4417-4225-b320-0f38cd075e59 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 11:55:27.069100 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-4adb81bb-d738-413e-adfe-d2aa246474de tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:27.072750 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-4adb81bb-d738-413e-adfe-d2aa246474de tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 6e9aaa29-4417-4225-b320-0f38cd075e59] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:27.076238 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-4adb81bb-d738-413e-adfe-d2aa246474de tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:27.076689 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-4adb81bb-d738-413e-adfe-d2aa246474de tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:27.077444 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-4adb81bb-d738-413e-adfe-d2aa246474de tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:27.077910 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-4adb81bb-d738-413e-adfe-d2aa246474de tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:27.207472 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-4adb81bb-d738-413e-adfe-d2aa246474de tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:27.214966 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-4adb81bb-d738-413e-adfe-d2aa246474de tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/6e9aaa29-4417-4225-b320-0f38cd075e59" status: 200 len: 1682 microversion: 2.1 time: 0.149740 Jun 23 11:55:27.215530 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 554/1100] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:27 2022] GET /compute/v2.1/servers/6e9aaa29-4417-4225-b320-0f38cd075e59 => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:27.453541 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-a8b9e0a3-bd2d-439b-9d1c-c0a77d92f799 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:27.454246 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-a8b9e0a3-bd2d-439b-9d1c-c0a77d92f799 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: f0c76b74-bb63-4f9a-aede-52182140750b] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:27.460315 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-a8b9e0a3-bd2d-439b-9d1c-c0a77d92f799 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:27.460771 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-a8b9e0a3-bd2d-439b-9d1c-c0a77d92f799 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:27.461532 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-a8b9e0a3-bd2d-439b-9d1c-c0a77d92f799 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:27.461973 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-a8b9e0a3-bd2d-439b-9d1c-c0a77d92f799 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:27.593365 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-a8b9e0a3-bd2d-439b-9d1c-c0a77d92f799 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:27.601329 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-a8b9e0a3-bd2d-439b-9d1c-c0a77d92f799 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/f0c76b74-bb63-4f9a-aede-52182140750b" status: 200 len: 1674 microversion: 2.1 time: 0.152079 Jun 23 11:55:27.601893 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 547/1101] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:27 2022] GET /compute/v2.1/servers/f0c76b74-bb63-4f9a-aede-52182140750b => generated 1674 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:28.232762 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-bafe709c-6759-436a-9932-fc63d0aa08ba tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:28.233371 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-bafe709c-6759-436a-9932-fc63d0aa08ba tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 6e9aaa29-4417-4225-b320-0f38cd075e59] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:28.240171 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-bafe709c-6759-436a-9932-fc63d0aa08ba tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:28.240621 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-bafe709c-6759-436a-9932-fc63d0aa08ba tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:28.241381 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-bafe709c-6759-436a-9932-fc63d0aa08ba tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:28.241813 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-bafe709c-6759-436a-9932-fc63d0aa08ba tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:28.369606 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-bafe709c-6759-436a-9932-fc63d0aa08ba tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:28.377695 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-bafe709c-6759-436a-9932-fc63d0aa08ba tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/6e9aaa29-4417-4225-b320-0f38cd075e59" status: 200 len: 1682 microversion: 2.1 time: 0.149072 Jun 23 11:55:28.378261 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 555/1102] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:28 2022] GET /compute/v2.1/servers/6e9aaa29-4417-4225-b320-0f38cd075e59 => generated 1682 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:28.619520 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-d6921f67-360d-4517-9e6b-8292221a0bf2 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:28.620065 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-d6921f67-360d-4517-9e6b-8292221a0bf2 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: f0c76b74-bb63-4f9a-aede-52182140750b] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:28.627327 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-d6921f67-360d-4517-9e6b-8292221a0bf2 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:28.627773 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-d6921f67-360d-4517-9e6b-8292221a0bf2 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:28.628523 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-d6921f67-360d-4517-9e6b-8292221a0bf2 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:28.628953 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-d6921f67-360d-4517-9e6b-8292221a0bf2 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:28.760896 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-d6921f67-360d-4517-9e6b-8292221a0bf2 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:28.768526 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-d6921f67-360d-4517-9e6b-8292221a0bf2 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/f0c76b74-bb63-4f9a-aede-52182140750b" status: 200 len: 1674 microversion: 2.1 time: 0.152917 Jun 23 11:55:28.769088 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 548/1103] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:28 2022] GET /compute/v2.1/servers/f0c76b74-bb63-4f9a-aede-52182140750b => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:29.395074 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-5063f7df-67c3-4255-8d18-90610b4bdd1f tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:29.395690 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-5063f7df-67c3-4255-8d18-90610b4bdd1f tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 6e9aaa29-4417-4225-b320-0f38cd075e59] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:29.402166 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-5063f7df-67c3-4255-8d18-90610b4bdd1f tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:29.402654 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-5063f7df-67c3-4255-8d18-90610b4bdd1f tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:29.403418 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-5063f7df-67c3-4255-8d18-90610b4bdd1f tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:29.403857 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-5063f7df-67c3-4255-8d18-90610b4bdd1f tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:29.565512 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-5063f7df-67c3-4255-8d18-90610b4bdd1f tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:29.573112 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-5063f7df-67c3-4255-8d18-90610b4bdd1f tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/6e9aaa29-4417-4225-b320-0f38cd075e59" status: 200 len: 1682 microversion: 2.1 time: 0.182514 Jun 23 11:55:29.573672 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 556/1104] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:29 2022] GET /compute/v2.1/servers/6e9aaa29-4417-4225-b320-0f38cd075e59 => generated 1682 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:29.785891 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-486ba3fc-a6e5-47ce-83ae-ec046dd4894d tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:29.786504 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-486ba3fc-a6e5-47ce-83ae-ec046dd4894d tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: f0c76b74-bb63-4f9a-aede-52182140750b] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:29.793328 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-486ba3fc-a6e5-47ce-83ae-ec046dd4894d tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:29.793778 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-486ba3fc-a6e5-47ce-83ae-ec046dd4894d tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:29.794599 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-486ba3fc-a6e5-47ce-83ae-ec046dd4894d tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:29.795047 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-486ba3fc-a6e5-47ce-83ae-ec046dd4894d tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:29.810725 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:55:30.044910 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-486ba3fc-a6e5-47ce-83ae-ec046dd4894d tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:30.052657 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-486ba3fc-a6e5-47ce-83ae-ec046dd4894d tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/f0c76b74-bb63-4f9a-aede-52182140750b" status: 200 len: 1674 microversion: 2.1 time: 0.271304 Jun 23 11:55:30.053231 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 549/1105] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:29 2022] GET /compute/v2.1/servers/f0c76b74-bb63-4f9a-aede-52182140750b => generated 1674 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:30.591449 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-4ff177db-fff1-4bc4-8c39-98b879486eb0 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:30.592061 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-4ff177db-fff1-4bc4-8c39-98b879486eb0 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 6e9aaa29-4417-4225-b320-0f38cd075e59] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:30.599748 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-4ff177db-fff1-4bc4-8c39-98b879486eb0 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:30.600487 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-4ff177db-fff1-4bc4-8c39-98b879486eb0 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:30.600986 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-4ff177db-fff1-4bc4-8c39-98b879486eb0 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:30.601414 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-4ff177db-fff1-4bc4-8c39-98b879486eb0 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:30.829926 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-4ff177db-fff1-4bc4-8c39-98b879486eb0 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:30.837104 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-4ff177db-fff1-4bc4-8c39-98b879486eb0 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/6e9aaa29-4417-4225-b320-0f38cd075e59" status: 200 len: 1682 microversion: 2.1 time: 0.249431 Jun 23 11:55:30.847279 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [req-689a5499-0db8-4464-9e5b-7ecc031a86fa req-5e3bf7e5-cc38-4fa5-9c87-aae9202833c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0c76b74-bb63-4f9a-aede-52182140750b", "name": "network-vif-deleted", "tag": "f26edc32-0ff6-4bcf-9cbf-72ae91e04852"}]} {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:55:30.847947 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 557/1106] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:30 2022] GET /compute/v2.1/servers/6e9aaa29-4417-4225-b320-0f38cd075e59 => generated 1682 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:30.858800 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [req-689a5499-0db8-4464-9e5b-7ecc031a86fa req-5e3bf7e5-cc38-4fa5-9c87-aae9202833c5 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:30.864576 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [req-689a5499-0db8-4464-9e5b-7ecc031a86fa req-5e3bf7e5-cc38-4fa5-9c87-aae9202833c5 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:30.883298 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.compute.server_external_events [req-689a5499-0db8-4464-9e5b-7ecc031a86fa req-5e3bf7e5-cc38-4fa5-9c87-aae9202833c5 service nova] Creating event network-vif-deleted:f26edc32-0ff6-4bcf-9cbf-72ae91e04852 for instance f0c76b74-bb63-4f9a-aede-52182140750b on hv-cinder-82099 Jun 23 11:55:30.888680 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [req-689a5499-0db8-4464-9e5b-7ecc031a86fa req-5e3bf7e5-cc38-4fa5-9c87-aae9202833c5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052764 Jun 23 11:55:30.892887 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 550/1107] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:55:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:55:31.074068 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-add3c92c-389e-4002-8075-32a12ac82cda tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:31.075017 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-add3c92c-389e-4002-8075-32a12ac82cda tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: f0c76b74-bb63-4f9a-aede-52182140750b] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:31.083845 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-add3c92c-389e-4002-8075-32a12ac82cda tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:31.086000 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-add3c92c-389e-4002-8075-32a12ac82cda tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:31.105575 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-add3c92c-389e-4002-8075-32a12ac82cda tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:31.107050 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-add3c92c-389e-4002-8075-32a12ac82cda tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:31.160849 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [req-11c64944-6cb4-4170-8c9f-9eb78ffadcd6 req-8da51115-8521-41e4-b1f2-ddfff7df7ca2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e9aaa29-4417-4225-b320-0f38cd075e59", "name": "network-vif-deleted", "tag": "91673040-ce00-4c33-ac8c-8d94ff6b820a"}]} {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:55:31.182051 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-11c64944-6cb4-4170-8c9f-9eb78ffadcd6 req-8da51115-8521-41e4-b1f2-ddfff7df7ca2 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:31.182854 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-11c64944-6cb4-4170-8c9f-9eb78ffadcd6 req-8da51115-8521-41e4-b1f2-ddfff7df7ca2 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:31.209147 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.compute.server_external_events [req-11c64944-6cb4-4170-8c9f-9eb78ffadcd6 req-8da51115-8521-41e4-b1f2-ddfff7df7ca2 service nova] Creating event network-vif-deleted:91673040-ce00-4c33-ac8c-8d94ff6b820a for instance 6e9aaa29-4417-4225-b320-0f38cd075e59 on hv-cinder-82099 Jun 23 11:55:31.216702 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-add3c92c-389e-4002-8075-32a12ac82cda tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b988f3241a46308b7c3683e2943b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45db495ff8c04b55b44c80a3ab412fb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:31.223389 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [req-11c64944-6cb4-4170-8c9f-9eb78ffadcd6 req-8da51115-8521-41e4-b1f2-ddfff7df7ca2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.194056 Jun 23 11:55:31.227036 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-add3c92c-389e-4002-8075-32a12ac82cda tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/f0c76b74-bb63-4f9a-aede-52182140750b" status: 200 len: 1322 microversion: 2.1 time: 0.160695 Jun 23 11:55:31.228334 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 551/1108] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:31 2022] GET /compute/v2.1/servers/f0c76b74-bb63-4f9a-aede-52182140750b => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:31.242978 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 558/1109] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:55:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:55:31.855555 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-ff8ce6bc-8166-4bcc-93f7-0cc57ac1e831 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:31.856155 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-ff8ce6bc-8166-4bcc-93f7-0cc57ac1e831 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 6e9aaa29-4417-4225-b320-0f38cd075e59] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:31.864072 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ff8ce6bc-8166-4bcc-93f7-0cc57ac1e831 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:31.864526 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ff8ce6bc-8166-4bcc-93f7-0cc57ac1e831 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:31.865288 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ff8ce6bc-8166-4bcc-93f7-0cc57ac1e831 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:31.865718 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ff8ce6bc-8166-4bcc-93f7-0cc57ac1e831 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:31.902977 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ff8ce6bc-8166-4bcc-93f7-0cc57ac1e831 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:31.903468 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ff8ce6bc-8166-4bcc-93f7-0cc57ac1e831 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:31.903922 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.objects.instance [None req-ff8ce6bc-8166-4bcc-93f7-0cc57ac1e831 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lazy-loading 'fault' on Instance uuid 6e9aaa29-4417-4225-b320-0f38cd075e59 {{(pid=124669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:55:31.948186 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-ff8ce6bc-8166-4bcc-93f7-0cc57ac1e831 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7fd8323d29d445f903e2103453e8ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee135767dfc846469d64b658372994a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:31.957513 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-ff8ce6bc-8166-4bcc-93f7-0cc57ac1e831 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/6e9aaa29-4417-4225-b320-0f38cd075e59" status: 200 len: 1331 microversion: 2.1 time: 0.106217 Jun 23 11:55:31.958091 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 552/1110] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:31 2022] GET /compute/v2.1/servers/6e9aaa29-4417-4225-b320-0f38cd075e59 => generated 1331 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:32.246990 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-b87c9294-04dd-43c4-a1ae-46dc2580451a tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:32.247840 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-b87c9294-04dd-43c4-a1ae-46dc2580451a tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: f0c76b74-bb63-4f9a-aede-52182140750b] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:32.277625 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-b87c9294-04dd-43c4-a1ae-46dc2580451a tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:32.277625 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-b87c9294-04dd-43c4-a1ae-46dc2580451a tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:32.277625 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-b87c9294-04dd-43c4-a1ae-46dc2580451a tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:32.277625 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-b87c9294-04dd-43c4-a1ae-46dc2580451a tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:32.278994 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.wsgi [None req-b87c9294-04dd-43c4-a1ae-46dc2580451a tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] HTTP exception thrown: Instance f0c76b74-bb63-4f9a-aede-52182140750b could not be found. Jun 23 11:55:32.278994 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-b87c9294-04dd-43c4-a1ae-46dc2580451a tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Request method failure captured: Jun 23 11:55:32.278994 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: request: GET /compute/v2.1/servers/f0c76b74-bb63-4f9a-aede-52182140750b HTTP/1.1 Jun 23 11:55:32.278994 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Accept: application/json Jun 23 11:55:32.278994 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Accept-Encoding: identity Jun 23 11:55:32.278994 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Connection: close Jun 23 11:55:32.278994 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Content-Length: 0 Jun 23 11:55:32.278994 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Content-Type: application/json Jun 23 11:55:32.278994 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Host: 10.222.0.13 Jun 23 11:55:32.278994 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Openstack-System-Scope: None Jun 23 11:55:32.278994 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: User-Agent: python-urllib3/1.26.9 Jun 23 11:55:32.278994 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Auth-Token: gAAAAABitFIUQzOKuurMnNUOBvgY4yrpwEpnJMiMRzCK2tzH0MUYk3j0socpW3oTND0Y-B0317GKEWcjAzAVg9cfaIVQTXrjnZagc0UeMsJBhfIMA6yFi6o2shaxocTT76xdSS-L5NqwUWnNEvP-ma1e0DcCmcptGshQYH5SdpjbuMIl853SdqE Jun 23 11:55:32.278994 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Domain-Id: None Jun 23 11:55:32.278994 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Domain-Name: None Jun 23 11:55:32.278994 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Identity-Status: Confirmed Jun 23 11:55:32.278994 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Is-Admin-Project: True Jun 23 11:55:32.278994 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Domain-Id: default Jun 23 11:55:32.278994 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Domain-Name: Default Jun 23 11:55:32.278994 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Id: 45db495ff8c04b55b44c80a3ab412fb9 Jun 23 11:55:32.278994 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Name: tempest-AttachVolumeTestJSON-552659924 Jun 23 11:55:32.278994 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Role: member,reader Jun 23 11:55:32.278994 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Roles: member,reader Jun 23 11:55:32.281361 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_45db495ff8c04b55b44c80a3ab412fb9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/45db495ff8c04b55b44c80a3ab412fb9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/45db495ff8c04b55b44c80a3ab412fb9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/45db495ff8c04b55b44c80a3ab412fb9"}]}] Jun 23 11:55:32.281361 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Tenant: tempest-AttachVolumeTestJSON-552659924 Jun 23 11:55:32.281361 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Tenant-Id: 45db495ff8c04b55b44c80a3ab412fb9 Jun 23 11:55:32.281361 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Tenant-Name: tempest-AttachVolumeTestJSON-552659924 Jun 23 11:55:32.281361 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User: tempest-AttachVolumeTestJSON-552659924-project Jun 23 11:55:32.281361 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Domain-Id: default Jun 23 11:55:32.281361 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Domain-Name: Default Jun 23 11:55:32.281361 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Id: d1b988f3241a46308b7c3683e2943b78 Jun 23 11:55:32.281361 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Name: tempest-AttachVolumeTestJSON-552659924-project Jun 23 11:55:32.281361 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: method: > Jun 23 11:55:32.281361 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: exception: Instance f0c76b74-bb63-4f9a-aede-52182140750b could not be found. Jun 23 11:55:32.281361 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: action_args: {'id': 'f0c76b74-bb63-4f9a-aede-52182140750b'} Jun 23 11:55:32.282623 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:55:32.282623 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:55:32.282623 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:55:32.282623 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:55:32.282623 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:55:32.282623 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:55:32.282623 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:55:32.282623 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:55:32.282623 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:55:32.282623 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:55:32.282623 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0c76b74-bb63-4f9a-aede-52182140750b could not be found. Jun 23 11:55:32.282623 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:55:32.282623 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:55:32.282623 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:55:32.282623 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:55:32.282623 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:55:32.282623 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:55:32.282623 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:55:32.282623 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:55:32.282623 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:55:32.285480 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:55:32.285480 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 11:55:32.285480 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 11:55:32.285480 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:55:32.285480 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:55:32.285480 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:55:32.285480 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:55:32.285480 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0c76b74-bb63-4f9a-aede-52182140750b could not be found. Jun 23 11:55:32.285480 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:55:32.285480 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:55:32.285480 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:55:32.285480 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:55:32.285480 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:55:32.285480 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:55:32.285480 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:55:32.285480 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:55:32.285480 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0c76b74-bb63-4f9a-aede-52182140750b could not be found. Jun 23 11:55:32.285480 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:55:32.288265 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-b87c9294-04dd-43c4-a1ae-46dc2580451a tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Returning 404 to user: Instance f0c76b74-bb63-4f9a-aede-52182140750b could not be found. {{(pid=124670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:55:32.288265 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-b87c9294-04dd-43c4-a1ae-46dc2580451a tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/f0c76b74-bb63-4f9a-aede-52182140750b" status: 404 len: 111 microversion: 2.1 time: 0.038592 Jun 23 11:55:32.291279 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-c8cd390b-1312-49ec-acd7-7a126aafb1e3 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '.version_select at 0x7f5d06fa8430>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:32.295128 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 559/1111] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:32 2022] GET /compute/v2.1/servers/f0c76b74-bb63-4f9a-aede-52182140750b => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:55:32.474882 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-c8cd390b-1312-49ec-acd7-7a126aafb1e3 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-552322715" status: 202 len: 0 microversion: 2.1 time: 0.187943 Jun 23 11:55:32.478725 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 553/1112] 10.222.0.13 () {58 vars in 1217 bytes} [Thu Jun 23 11:55:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-552322715 => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 11:55:32.975695 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-1a46ff1e-c127-4aa0-a556-d2bb929d374c tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:32.976440 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-1a46ff1e-c127-4aa0-a556-d2bb929d374c tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 6e9aaa29-4417-4225-b320-0f38cd075e59] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:32.982683 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1a46ff1e-c127-4aa0-a556-d2bb929d374c tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:32.983126 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1a46ff1e-c127-4aa0-a556-d2bb929d374c tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:32.983876 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1a46ff1e-c127-4aa0-a556-d2bb929d374c tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:32.985114 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1a46ff1e-c127-4aa0-a556-d2bb929d374c tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:32.999031 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.wsgi [None req-1a46ff1e-c127-4aa0-a556-d2bb929d374c tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] HTTP exception thrown: Instance 6e9aaa29-4417-4225-b320-0f38cd075e59 could not be found. Jun 23 11:55:33.001190 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-1a46ff1e-c127-4aa0-a556-d2bb929d374c tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Request method failure captured: Jun 23 11:55:33.001190 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: request: GET /compute/v2.1/servers/6e9aaa29-4417-4225-b320-0f38cd075e59 HTTP/1.1 Jun 23 11:55:33.001190 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Accept: application/json Jun 23 11:55:33.001190 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Accept-Encoding: identity Jun 23 11:55:33.001190 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Connection: close Jun 23 11:55:33.001190 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Content-Length: 0 Jun 23 11:55:33.001190 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Content-Type: application/json Jun 23 11:55:33.001190 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Host: 10.222.0.13 Jun 23 11:55:33.001190 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Openstack-System-Scope: None Jun 23 11:55:33.001190 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: User-Agent: python-urllib3/1.26.9 Jun 23 11:55:33.001190 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Auth-Token: gAAAAABitFIKMke7vIBbvXT2RfPc-4frmGbwTZtMddIa6SPtgPblRzRqc8HMry6yk8WPdy-omEmS4IGKEBZ0krkMZ2AKKZ3XIi6QwXYCvuOyoif5_u-lfFNTFOpNeH9m810_qoSsO3823Vbqo3_NJM0PRtSxfQcTjP265INpx0gWYDOG-d8IrtY Jun 23 11:55:33.001190 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Domain-Id: None Jun 23 11:55:33.001190 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Domain-Name: None Jun 23 11:55:33.001190 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Identity-Status: Confirmed Jun 23 11:55:33.001190 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Is-Admin-Project: True Jun 23 11:55:33.001190 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Domain-Id: default Jun 23 11:55:33.001190 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Domain-Name: Default Jun 23 11:55:33.001190 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Id: ee135767dfc846469d64b658372994a8 Jun 23 11:55:33.001190 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Name: tempest-AttachVolumeNegativeTest-213077295 Jun 23 11:55:33.001190 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Role: member,reader Jun 23 11:55:33.001190 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Roles: member,reader Jun 23 11:55:33.008627 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ee135767dfc846469d64b658372994a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ee135767dfc846469d64b658372994a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ee135767dfc846469d64b658372994a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ee135767dfc846469d64b658372994a8"}]}] Jun 23 11:55:33.008627 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Tenant: tempest-AttachVolumeNegativeTest-213077295 Jun 23 11:55:33.008627 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Tenant-Id: ee135767dfc846469d64b658372994a8 Jun 23 11:55:33.008627 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-213077295 Jun 23 11:55:33.008627 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User: tempest-AttachVolumeNegativeTest-213077295-project Jun 23 11:55:33.008627 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Domain-Id: default Jun 23 11:55:33.008627 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Domain-Name: Default Jun 23 11:55:33.008627 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Id: b7fd8323d29d445f903e2103453e8ae6 Jun 23 11:55:33.008627 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Name: tempest-AttachVolumeNegativeTest-213077295-project Jun 23 11:55:33.008627 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: method: > Jun 23 11:55:33.008627 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: exception: Instance 6e9aaa29-4417-4225-b320-0f38cd075e59 could not be found. Jun 23 11:55:33.008627 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: action_args: {'id': '6e9aaa29-4417-4225-b320-0f38cd075e59'} Jun 23 11:55:33.009592 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:55:33.009592 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:55:33.009592 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:55:33.009592 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:55:33.009592 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:55:33.009592 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:55:33.009592 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:55:33.009592 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:55:33.009592 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:55:33.009592 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:55:33.009592 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e9aaa29-4417-4225-b320-0f38cd075e59 could not be found. Jun 23 11:55:33.009592 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:55:33.009592 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:55:33.009592 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:55:33.009592 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:55:33.009592 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:55:33.009592 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:55:33.009592 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:55:33.009592 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:55:33.009592 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:55:33.011256 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:55:33.011256 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 11:55:33.011256 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 11:55:33.011256 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:55:33.011256 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:55:33.011256 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:55:33.011256 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:55:33.011256 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e9aaa29-4417-4225-b320-0f38cd075e59 could not be found. Jun 23 11:55:33.011256 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:55:33.011256 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:55:33.011256 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:55:33.011256 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:55:33.011256 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:55:33.011256 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:55:33.011256 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:55:33.011256 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:55:33.011256 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e9aaa29-4417-4225-b320-0f38cd075e59 could not be found. Jun 23 11:55:33.011256 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:55:33.012751 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-1a46ff1e-c127-4aa0-a556-d2bb929d374c tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Returning 404 to user: Instance 6e9aaa29-4417-4225-b320-0f38cd075e59 could not be found. {{(pid=124670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:55:33.012751 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-1a46ff1e-c127-4aa0-a556-d2bb929d374c tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/6e9aaa29-4417-4225-b320-0f38cd075e59" status: 404 len: 111 microversion: 2.1 time: 0.030785 Jun 23 11:55:33.012751 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 560/1113] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:32 2022] GET /compute/v2.1/servers/6e9aaa29-4417-4225-b320-0f38cd075e59 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:55:33.013043 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-9aa598d2-f29f-4069-8710-9a2ed76b2d25 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '.version_select at 0x7f5d06f5eca0>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:33.112894 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-9aa598d2-f29f-4069-8710-9a2ed76b2d25 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1357719903" status: 202 len: 0 microversion: 2.1 time: 0.104995 Jun 23 11:55:33.113402 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 554/1114] 10.222.0.13 () {58 vars in 1220 bytes} [Thu Jun 23 11:55:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1357719903 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 11:55:35.236053 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-9a5269f1-2e7d-4924-867f-c3ffa38c136e tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:35.236544 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-9a5269f1-2e7d-4924-867f-c3ffa38c136e tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 6e9aaa29-4417-4225-b320-0f38cd075e59] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:35.243031 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-9a5269f1-2e7d-4924-867f-c3ffa38c136e tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:35.243486 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-9a5269f1-2e7d-4924-867f-c3ffa38c136e tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:35.244249 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-9a5269f1-2e7d-4924-867f-c3ffa38c136e tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:35.244689 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-9a5269f1-2e7d-4924-867f-c3ffa38c136e tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:35.257999 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.wsgi [None req-9a5269f1-2e7d-4924-867f-c3ffa38c136e tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] HTTP exception thrown: Instance 6e9aaa29-4417-4225-b320-0f38cd075e59 could not be found. Jun 23 11:55:35.259583 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-9a5269f1-2e7d-4924-867f-c3ffa38c136e tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Request method failure captured: Jun 23 11:55:35.259583 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: request: DELETE /compute/v2.1/servers/6e9aaa29-4417-4225-b320-0f38cd075e59 HTTP/1.1 Jun 23 11:55:35.259583 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Accept: application/json Jun 23 11:55:35.259583 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Accept-Encoding: identity Jun 23 11:55:35.259583 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Connection: close Jun 23 11:55:35.259583 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Content-Length: 0 Jun 23 11:55:35.259583 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Content-Type: application/json Jun 23 11:55:35.259583 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Host: 10.222.0.13 Jun 23 11:55:35.259583 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Openstack-System-Scope: None Jun 23 11:55:35.259583 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: User-Agent: python-urllib3/1.26.9 Jun 23 11:55:35.259583 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Auth-Token: gAAAAABitFIKMke7vIBbvXT2RfPc-4frmGbwTZtMddIa6SPtgPblRzRqc8HMry6yk8WPdy-omEmS4IGKEBZ0krkMZ2AKKZ3XIi6QwXYCvuOyoif5_u-lfFNTFOpNeH9m810_qoSsO3823Vbqo3_NJM0PRtSxfQcTjP265INpx0gWYDOG-d8IrtY Jun 23 11:55:35.259583 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Domain-Id: None Jun 23 11:55:35.259583 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Domain-Name: None Jun 23 11:55:35.259583 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Identity-Status: Confirmed Jun 23 11:55:35.259583 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Is-Admin-Project: True Jun 23 11:55:35.259583 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Domain-Id: default Jun 23 11:55:35.259583 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Domain-Name: Default Jun 23 11:55:35.259583 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Id: ee135767dfc846469d64b658372994a8 Jun 23 11:55:35.259583 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Name: tempest-AttachVolumeNegativeTest-213077295 Jun 23 11:55:35.259583 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Role: member,reader Jun 23 11:55:35.259583 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Roles: member,reader Jun 23 11:55:35.261137 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ee135767dfc846469d64b658372994a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ee135767dfc846469d64b658372994a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ee135767dfc846469d64b658372994a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ee135767dfc846469d64b658372994a8"}]}] Jun 23 11:55:35.261137 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Tenant: tempest-AttachVolumeNegativeTest-213077295 Jun 23 11:55:35.261137 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Tenant-Id: ee135767dfc846469d64b658372994a8 Jun 23 11:55:35.261137 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-213077295 Jun 23 11:55:35.261137 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User: tempest-AttachVolumeNegativeTest-213077295-project Jun 23 11:55:35.261137 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Domain-Id: default Jun 23 11:55:35.261137 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Domain-Name: Default Jun 23 11:55:35.261137 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Id: b7fd8323d29d445f903e2103453e8ae6 Jun 23 11:55:35.261137 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Name: tempest-AttachVolumeNegativeTest-213077295-project Jun 23 11:55:35.261137 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: method: > Jun 23 11:55:35.261137 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: exception: Instance 6e9aaa29-4417-4225-b320-0f38cd075e59 could not be found. Jun 23 11:55:35.261137 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: action_args: {'id': '6e9aaa29-4417-4225-b320-0f38cd075e59'} Jun 23 11:55:35.262049 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:55:35.262049 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:55:35.262049 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:55:35.262049 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:55:35.262049 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:55:35.262049 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:55:35.262049 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:55:35.262049 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:55:35.262049 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:55:35.262049 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:55:35.262049 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e9aaa29-4417-4225-b320-0f38cd075e59 could not be found. Jun 23 11:55:35.262049 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:55:35.262049 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:55:35.262049 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:55:35.262049 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:55:35.262049 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:55:35.262049 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:55:35.262049 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:55:35.262049 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:55:35.262049 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:55:35.263422 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:55:35.263422 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 11:55:35.263422 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 11:55:35.263422 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 11:55:35.263422 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 11:55:35.263422 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:55:35.263422 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:55:35.263422 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:55:35.263422 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:55:35.263422 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e9aaa29-4417-4225-b320-0f38cd075e59 could not be found. Jun 23 11:55:35.263422 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:55:35.263422 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:55:35.263422 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:55:35.263422 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:55:35.263422 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:55:35.263422 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:55:35.263422 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:55:35.263422 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:55:35.263422 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e9aaa29-4417-4225-b320-0f38cd075e59 could not be found. Jun 23 11:55:35.263422 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:55:35.264799 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-9a5269f1-2e7d-4924-867f-c3ffa38c136e tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Returning 404 to user: Instance 6e9aaa29-4417-4225-b320-0f38cd075e59 could not be found. {{(pid=124670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:55:35.264799 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-9a5269f1-2e7d-4924-867f-c3ffa38c136e tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "DELETE /compute/v2.1/servers/6e9aaa29-4417-4225-b320-0f38cd075e59" status: 404 len: 111 microversion: 2.1 time: 0.029343 Jun 23 11:55:35.264799 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 561/1115] 10.222.0.13 () {58 vars in 1238 bytes} [Thu Jun 23 11:55:35 2022] DELETE /compute/v2.1/servers/6e9aaa29-4417-4225-b320-0f38cd075e59 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:55:35.271026 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-f74de1f9-98a3-4eff-b710-30894c7b19e6 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:35.271636 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-f74de1f9-98a3-4eff-b710-30894c7b19e6 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 6e9aaa29-4417-4225-b320-0f38cd075e59] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:35.278562 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-f74de1f9-98a3-4eff-b710-30894c7b19e6 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:35.279078 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-f74de1f9-98a3-4eff-b710-30894c7b19e6 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:35.279890 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-f74de1f9-98a3-4eff-b710-30894c7b19e6 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:35.280343 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-f74de1f9-98a3-4eff-b710-30894c7b19e6 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:35.294132 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.wsgi [None req-f74de1f9-98a3-4eff-b710-30894c7b19e6 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] HTTP exception thrown: Instance 6e9aaa29-4417-4225-b320-0f38cd075e59 could not be found. Jun 23 11:55:35.295822 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-f74de1f9-98a3-4eff-b710-30894c7b19e6 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Request method failure captured: Jun 23 11:55:35.295822 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: request: GET /compute/v2.1/servers/6e9aaa29-4417-4225-b320-0f38cd075e59 HTTP/1.1 Jun 23 11:55:35.295822 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Accept: application/json Jun 23 11:55:35.295822 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Accept-Encoding: identity Jun 23 11:55:35.295822 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Connection: close Jun 23 11:55:35.295822 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Content-Length: 0 Jun 23 11:55:35.295822 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Content-Type: application/json Jun 23 11:55:35.295822 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Host: 10.222.0.13 Jun 23 11:55:35.295822 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Openstack-System-Scope: None Jun 23 11:55:35.295822 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: User-Agent: python-urllib3/1.26.9 Jun 23 11:55:35.295822 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Auth-Token: gAAAAABitFIKMke7vIBbvXT2RfPc-4frmGbwTZtMddIa6SPtgPblRzRqc8HMry6yk8WPdy-omEmS4IGKEBZ0krkMZ2AKKZ3XIi6QwXYCvuOyoif5_u-lfFNTFOpNeH9m810_qoSsO3823Vbqo3_NJM0PRtSxfQcTjP265INpx0gWYDOG-d8IrtY Jun 23 11:55:35.295822 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Domain-Id: None Jun 23 11:55:35.295822 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Domain-Name: None Jun 23 11:55:35.295822 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Identity-Status: Confirmed Jun 23 11:55:35.295822 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Is-Admin-Project: True Jun 23 11:55:35.295822 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Domain-Id: default Jun 23 11:55:35.295822 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Domain-Name: Default Jun 23 11:55:35.295822 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Id: ee135767dfc846469d64b658372994a8 Jun 23 11:55:35.295822 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Name: tempest-AttachVolumeNegativeTest-213077295 Jun 23 11:55:35.295822 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Role: member,reader Jun 23 11:55:35.295822 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Roles: member,reader Jun 23 11:55:35.302166 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ee135767dfc846469d64b658372994a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ee135767dfc846469d64b658372994a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ee135767dfc846469d64b658372994a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ee135767dfc846469d64b658372994a8"}]}] Jun 23 11:55:35.302166 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant: tempest-AttachVolumeNegativeTest-213077295 Jun 23 11:55:35.302166 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant-Id: ee135767dfc846469d64b658372994a8 Jun 23 11:55:35.302166 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-213077295 Jun 23 11:55:35.302166 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User: tempest-AttachVolumeNegativeTest-213077295-project Jun 23 11:55:35.302166 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Domain-Id: default Jun 23 11:55:35.302166 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Domain-Name: Default Jun 23 11:55:35.302166 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Id: b7fd8323d29d445f903e2103453e8ae6 Jun 23 11:55:35.302166 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Name: tempest-AttachVolumeNegativeTest-213077295-project Jun 23 11:55:35.302166 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: method: > Jun 23 11:55:35.302166 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: exception: Instance 6e9aaa29-4417-4225-b320-0f38cd075e59 could not be found. Jun 23 11:55:35.302166 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: action_args: {'id': '6e9aaa29-4417-4225-b320-0f38cd075e59'} Jun 23 11:55:35.303106 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:55:35.303106 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:55:35.303106 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:55:35.303106 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:55:35.303106 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:55:35.303106 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:55:35.303106 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:55:35.303106 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:55:35.303106 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:55:35.303106 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:55:35.303106 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e9aaa29-4417-4225-b320-0f38cd075e59 could not be found. Jun 23 11:55:35.303106 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:55:35.303106 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:55:35.303106 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:55:35.303106 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:55:35.303106 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:55:35.303106 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:55:35.303106 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:55:35.303106 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:55:35.303106 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:55:35.304640 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:55:35.304640 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 11:55:35.304640 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 11:55:35.304640 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:55:35.304640 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:55:35.304640 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:55:35.304640 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:55:35.304640 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e9aaa29-4417-4225-b320-0f38cd075e59 could not be found. Jun 23 11:55:35.304640 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:55:35.304640 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:55:35.304640 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:55:35.304640 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:55:35.304640 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:55:35.304640 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:55:35.304640 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:55:35.304640 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:55:35.304640 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e9aaa29-4417-4225-b320-0f38cd075e59 could not be found. Jun 23 11:55:35.304640 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:55:35.306072 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-f74de1f9-98a3-4eff-b710-30894c7b19e6 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Returning 404 to user: Instance 6e9aaa29-4417-4225-b320-0f38cd075e59 could not be found. {{(pid=124669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:55:35.306072 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-f74de1f9-98a3-4eff-b710-30894c7b19e6 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/6e9aaa29-4417-4225-b320-0f38cd075e59" status: 404 len: 111 microversion: 2.1 time: 0.031588 Jun 23 11:55:35.306072 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 555/1116] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:35 2022] GET /compute/v2.1/servers/6e9aaa29-4417-4225-b320-0f38cd075e59 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:55:36.023252 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-7a2562a5-d262-4aed-93c2-9a09408ef7b9 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:36.023773 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-7a2562a5-d262-4aed-93c2-9a09408ef7b9 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: f0c76b74-bb63-4f9a-aede-52182140750b] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:36.029682 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-7a2562a5-d262-4aed-93c2-9a09408ef7b9 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:36.030132 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-7a2562a5-d262-4aed-93c2-9a09408ef7b9 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:36.030915 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-7a2562a5-d262-4aed-93c2-9a09408ef7b9 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:36.031605 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-7a2562a5-d262-4aed-93c2-9a09408ef7b9 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:36.044881 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.wsgi [None req-7a2562a5-d262-4aed-93c2-9a09408ef7b9 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] HTTP exception thrown: Instance f0c76b74-bb63-4f9a-aede-52182140750b could not be found. Jun 23 11:55:36.046409 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-7a2562a5-d262-4aed-93c2-9a09408ef7b9 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Request method failure captured: Jun 23 11:55:36.046409 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: request: DELETE /compute/v2.1/servers/f0c76b74-bb63-4f9a-aede-52182140750b HTTP/1.1 Jun 23 11:55:36.046409 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Accept: application/json Jun 23 11:55:36.046409 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Accept-Encoding: identity Jun 23 11:55:36.046409 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Connection: close Jun 23 11:55:36.046409 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Content-Length: 0 Jun 23 11:55:36.046409 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Content-Type: application/json Jun 23 11:55:36.046409 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Host: 10.222.0.13 Jun 23 11:55:36.046409 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Openstack-System-Scope: None Jun 23 11:55:36.046409 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: User-Agent: python-urllib3/1.26.9 Jun 23 11:55:36.046409 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Auth-Token: gAAAAABitFIUQzOKuurMnNUOBvgY4yrpwEpnJMiMRzCK2tzH0MUYk3j0socpW3oTND0Y-B0317GKEWcjAzAVg9cfaIVQTXrjnZagc0UeMsJBhfIMA6yFi6o2shaxocTT76xdSS-L5NqwUWnNEvP-ma1e0DcCmcptGshQYH5SdpjbuMIl853SdqE Jun 23 11:55:36.046409 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Domain-Id: None Jun 23 11:55:36.046409 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Domain-Name: None Jun 23 11:55:36.046409 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Identity-Status: Confirmed Jun 23 11:55:36.046409 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Is-Admin-Project: True Jun 23 11:55:36.046409 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Domain-Id: default Jun 23 11:55:36.046409 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Domain-Name: Default Jun 23 11:55:36.046409 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Id: 45db495ff8c04b55b44c80a3ab412fb9 Jun 23 11:55:36.046409 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Name: tempest-AttachVolumeTestJSON-552659924 Jun 23 11:55:36.046409 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Role: member,reader Jun 23 11:55:36.046409 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Roles: member,reader Jun 23 11:55:36.048800 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_45db495ff8c04b55b44c80a3ab412fb9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/45db495ff8c04b55b44c80a3ab412fb9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/45db495ff8c04b55b44c80a3ab412fb9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/45db495ff8c04b55b44c80a3ab412fb9"}]}] Jun 23 11:55:36.048800 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Tenant: tempest-AttachVolumeTestJSON-552659924 Jun 23 11:55:36.048800 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Tenant-Id: 45db495ff8c04b55b44c80a3ab412fb9 Jun 23 11:55:36.048800 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Tenant-Name: tempest-AttachVolumeTestJSON-552659924 Jun 23 11:55:36.048800 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User: tempest-AttachVolumeTestJSON-552659924-project Jun 23 11:55:36.048800 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Domain-Id: default Jun 23 11:55:36.048800 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Domain-Name: Default Jun 23 11:55:36.048800 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Id: d1b988f3241a46308b7c3683e2943b78 Jun 23 11:55:36.048800 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Name: tempest-AttachVolumeTestJSON-552659924-project Jun 23 11:55:36.048800 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: method: > Jun 23 11:55:36.048800 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: exception: Instance f0c76b74-bb63-4f9a-aede-52182140750b could not be found. Jun 23 11:55:36.048800 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: action_args: {'id': 'f0c76b74-bb63-4f9a-aede-52182140750b'} Jun 23 11:55:36.049731 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:55:36.049731 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:55:36.049731 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:55:36.049731 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:55:36.049731 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:55:36.049731 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:55:36.049731 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:55:36.049731 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:55:36.049731 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:55:36.049731 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:55:36.049731 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0c76b74-bb63-4f9a-aede-52182140750b could not be found. Jun 23 11:55:36.049731 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:55:36.049731 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:55:36.049731 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:55:36.049731 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:55:36.049731 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:55:36.049731 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:55:36.049731 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:55:36.049731 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:55:36.049731 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:55:36.051258 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:55:36.051258 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 11:55:36.051258 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 11:55:36.051258 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 11:55:36.051258 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 11:55:36.051258 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:55:36.051258 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:55:36.051258 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:55:36.051258 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:55:36.051258 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0c76b74-bb63-4f9a-aede-52182140750b could not be found. Jun 23 11:55:36.051258 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:55:36.051258 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:55:36.051258 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:55:36.051258 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:55:36.051258 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:55:36.051258 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:55:36.051258 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:55:36.051258 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:55:36.051258 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0c76b74-bb63-4f9a-aede-52182140750b could not be found. Jun 23 11:55:36.051258 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:55:36.052564 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-7a2562a5-d262-4aed-93c2-9a09408ef7b9 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Returning 404 to user: Instance f0c76b74-bb63-4f9a-aede-52182140750b could not be found. {{(pid=124670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:55:36.052564 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-7a2562a5-d262-4aed-93c2-9a09408ef7b9 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "DELETE /compute/v2.1/servers/f0c76b74-bb63-4f9a-aede-52182140750b" status: 404 len: 111 microversion: 2.1 time: 0.028982 Jun 23 11:55:36.052564 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 562/1117] 10.222.0.13 () {58 vars in 1238 bytes} [Thu Jun 23 11:55:36 2022] DELETE /compute/v2.1/servers/f0c76b74-bb63-4f9a-aede-52182140750b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:55:36.058101 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-8ef9df95-29db-46e3-b7df-4d5a506c2990 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:36.058745 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-8ef9df95-29db-46e3-b7df-4d5a506c2990 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: f0c76b74-bb63-4f9a-aede-52182140750b] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:36.065873 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-8ef9df95-29db-46e3-b7df-4d5a506c2990 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:36.066321 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-8ef9df95-29db-46e3-b7df-4d5a506c2990 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:36.067110 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-8ef9df95-29db-46e3-b7df-4d5a506c2990 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:36.067542 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-8ef9df95-29db-46e3-b7df-4d5a506c2990 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:36.081282 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.wsgi [None req-8ef9df95-29db-46e3-b7df-4d5a506c2990 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] HTTP exception thrown: Instance f0c76b74-bb63-4f9a-aede-52182140750b could not be found. Jun 23 11:55:36.082859 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-8ef9df95-29db-46e3-b7df-4d5a506c2990 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Request method failure captured: Jun 23 11:55:36.082859 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: request: GET /compute/v2.1/servers/f0c76b74-bb63-4f9a-aede-52182140750b HTTP/1.1 Jun 23 11:55:36.082859 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Accept: application/json Jun 23 11:55:36.082859 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Accept-Encoding: identity Jun 23 11:55:36.082859 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Connection: close Jun 23 11:55:36.082859 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Content-Length: 0 Jun 23 11:55:36.082859 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Content-Type: application/json Jun 23 11:55:36.082859 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Host: 10.222.0.13 Jun 23 11:55:36.082859 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Openstack-System-Scope: None Jun 23 11:55:36.082859 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: User-Agent: python-urllib3/1.26.9 Jun 23 11:55:36.082859 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Auth-Token: gAAAAABitFIUQzOKuurMnNUOBvgY4yrpwEpnJMiMRzCK2tzH0MUYk3j0socpW3oTND0Y-B0317GKEWcjAzAVg9cfaIVQTXrjnZagc0UeMsJBhfIMA6yFi6o2shaxocTT76xdSS-L5NqwUWnNEvP-ma1e0DcCmcptGshQYH5SdpjbuMIl853SdqE Jun 23 11:55:36.082859 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Domain-Id: None Jun 23 11:55:36.082859 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Domain-Name: None Jun 23 11:55:36.082859 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Identity-Status: Confirmed Jun 23 11:55:36.082859 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Is-Admin-Project: True Jun 23 11:55:36.082859 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Domain-Id: default Jun 23 11:55:36.082859 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Domain-Name: Default Jun 23 11:55:36.082859 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Id: 45db495ff8c04b55b44c80a3ab412fb9 Jun 23 11:55:36.082859 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Name: tempest-AttachVolumeTestJSON-552659924 Jun 23 11:55:36.082859 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Role: member,reader Jun 23 11:55:36.082859 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Roles: member,reader Jun 23 11:55:36.084498 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_45db495ff8c04b55b44c80a3ab412fb9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/45db495ff8c04b55b44c80a3ab412fb9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/45db495ff8c04b55b44c80a3ab412fb9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/45db495ff8c04b55b44c80a3ab412fb9"}]}] Jun 23 11:55:36.084498 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant: tempest-AttachVolumeTestJSON-552659924 Jun 23 11:55:36.084498 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant-Id: 45db495ff8c04b55b44c80a3ab412fb9 Jun 23 11:55:36.084498 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant-Name: tempest-AttachVolumeTestJSON-552659924 Jun 23 11:55:36.084498 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User: tempest-AttachVolumeTestJSON-552659924-project Jun 23 11:55:36.084498 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Domain-Id: default Jun 23 11:55:36.084498 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Domain-Name: Default Jun 23 11:55:36.084498 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Id: d1b988f3241a46308b7c3683e2943b78 Jun 23 11:55:36.084498 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Name: tempest-AttachVolumeTestJSON-552659924-project Jun 23 11:55:36.084498 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: method: > Jun 23 11:55:36.084498 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: exception: Instance f0c76b74-bb63-4f9a-aede-52182140750b could not be found. Jun 23 11:55:36.084498 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: action_args: {'id': 'f0c76b74-bb63-4f9a-aede-52182140750b'} Jun 23 11:55:36.085392 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:55:36.085392 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:55:36.085392 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:55:36.085392 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:55:36.085392 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:55:36.085392 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:55:36.085392 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:55:36.085392 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:55:36.085392 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:55:36.085392 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:55:36.085392 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0c76b74-bb63-4f9a-aede-52182140750b could not be found. Jun 23 11:55:36.085392 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:55:36.085392 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:55:36.085392 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:55:36.085392 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:55:36.085392 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:55:36.085392 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:55:36.085392 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:55:36.085392 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:55:36.085392 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:55:36.086985 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:55:36.086985 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 11:55:36.086985 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 11:55:36.086985 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:55:36.086985 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:55:36.086985 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:55:36.086985 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:55:36.086985 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0c76b74-bb63-4f9a-aede-52182140750b could not be found. Jun 23 11:55:36.086985 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:55:36.086985 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:55:36.086985 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:55:36.086985 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:55:36.086985 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:55:36.086985 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:55:36.086985 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:55:36.086985 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:55:36.086985 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0c76b74-bb63-4f9a-aede-52182140750b could not be found. Jun 23 11:55:36.086985 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:55:36.088531 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-8ef9df95-29db-46e3-b7df-4d5a506c2990 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Returning 404 to user: Instance f0c76b74-bb63-4f9a-aede-52182140750b could not be found. {{(pid=124669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:55:36.088531 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-8ef9df95-29db-46e3-b7df-4d5a506c2990 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/f0c76b74-bb63-4f9a-aede-52182140750b" status: 404 len: 111 microversion: 2.1 time: 0.030020 Jun 23 11:55:36.088531 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 556/1118] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:36 2022] GET /compute/v2.1/servers/f0c76b74-bb63-4f9a-aede-52182140750b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:55:36.531528 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-1761c267-9bfd-430b-9120-4fc95769bd14 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:36.532595 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-1761c267-9bfd-430b-9120-4fc95769bd14 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 284456f6-2347-46c7-bec1-2acb170b7421] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:36.539210 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1761c267-9bfd-430b-9120-4fc95769bd14 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:36.539658 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1761c267-9bfd-430b-9120-4fc95769bd14 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:36.540399 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1761c267-9bfd-430b-9120-4fc95769bd14 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:36.540830 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1761c267-9bfd-430b-9120-4fc95769bd14 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:36.555437 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.wsgi [None req-1761c267-9bfd-430b-9120-4fc95769bd14 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] HTTP exception thrown: Instance 284456f6-2347-46c7-bec1-2acb170b7421 could not be found. Jun 23 11:55:36.557017 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-1761c267-9bfd-430b-9120-4fc95769bd14 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Request method failure captured: Jun 23 11:55:36.557017 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: request: DELETE /compute/v2.1/servers/284456f6-2347-46c7-bec1-2acb170b7421 HTTP/1.1 Jun 23 11:55:36.557017 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Accept: application/json Jun 23 11:55:36.557017 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Accept-Encoding: identity Jun 23 11:55:36.557017 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Connection: close Jun 23 11:55:36.557017 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Content-Length: 0 Jun 23 11:55:36.557017 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Content-Type: application/json Jun 23 11:55:36.557017 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Host: 10.222.0.13 Jun 23 11:55:36.557017 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Openstack-System-Scope: None Jun 23 11:55:36.557017 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: User-Agent: python-urllib3/1.26.9 Jun 23 11:55:36.557017 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Auth-Token: gAAAAABitFIKMke7vIBbvXT2RfPc-4frmGbwTZtMddIa6SPtgPblRzRqc8HMry6yk8WPdy-omEmS4IGKEBZ0krkMZ2AKKZ3XIi6QwXYCvuOyoif5_u-lfFNTFOpNeH9m810_qoSsO3823Vbqo3_NJM0PRtSxfQcTjP265INpx0gWYDOG-d8IrtY Jun 23 11:55:36.557017 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Domain-Id: None Jun 23 11:55:36.557017 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Domain-Name: None Jun 23 11:55:36.557017 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Identity-Status: Confirmed Jun 23 11:55:36.557017 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Is-Admin-Project: True Jun 23 11:55:36.557017 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Domain-Id: default Jun 23 11:55:36.557017 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Domain-Name: Default Jun 23 11:55:36.557017 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Id: ee135767dfc846469d64b658372994a8 Jun 23 11:55:36.557017 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Name: tempest-AttachVolumeNegativeTest-213077295 Jun 23 11:55:36.557017 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Role: member,reader Jun 23 11:55:36.557017 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Roles: member,reader Jun 23 11:55:36.558583 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ee135767dfc846469d64b658372994a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ee135767dfc846469d64b658372994a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ee135767dfc846469d64b658372994a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ee135767dfc846469d64b658372994a8"}]}] Jun 23 11:55:36.558583 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Tenant: tempest-AttachVolumeNegativeTest-213077295 Jun 23 11:55:36.558583 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Tenant-Id: ee135767dfc846469d64b658372994a8 Jun 23 11:55:36.558583 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-213077295 Jun 23 11:55:36.558583 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User: tempest-AttachVolumeNegativeTest-213077295-project Jun 23 11:55:36.558583 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Domain-Id: default Jun 23 11:55:36.558583 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Domain-Name: Default Jun 23 11:55:36.558583 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Id: b7fd8323d29d445f903e2103453e8ae6 Jun 23 11:55:36.558583 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Name: tempest-AttachVolumeNegativeTest-213077295-project Jun 23 11:55:36.558583 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: method: > Jun 23 11:55:36.558583 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: exception: Instance 284456f6-2347-46c7-bec1-2acb170b7421 could not be found. Jun 23 11:55:36.558583 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: action_args: {'id': '284456f6-2347-46c7-bec1-2acb170b7421'} Jun 23 11:55:36.559386 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:55:36.559386 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:55:36.559386 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:55:36.559386 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:55:36.559386 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:55:36.559386 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:55:36.559386 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:55:36.559386 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:55:36.559386 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:55:36.559386 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:55:36.559386 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 284456f6-2347-46c7-bec1-2acb170b7421 could not be found. Jun 23 11:55:36.559386 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:55:36.559386 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:55:36.559386 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:55:36.559386 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:55:36.559386 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:55:36.559386 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:55:36.559386 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:55:36.559386 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:55:36.559386 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:55:36.560940 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:55:36.560940 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 11:55:36.560940 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 11:55:36.560940 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 11:55:36.560940 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 11:55:36.560940 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:55:36.560940 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:55:36.560940 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:55:36.560940 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:55:36.560940 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 284456f6-2347-46c7-bec1-2acb170b7421 could not be found. Jun 23 11:55:36.560940 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:55:36.560940 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:55:36.560940 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:55:36.560940 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:55:36.560940 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:55:36.560940 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:55:36.560940 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:55:36.560940 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:55:36.560940 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 284456f6-2347-46c7-bec1-2acb170b7421 could not be found. Jun 23 11:55:36.560940 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:55:36.562515 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-1761c267-9bfd-430b-9120-4fc95769bd14 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Returning 404 to user: Instance 284456f6-2347-46c7-bec1-2acb170b7421 could not be found. {{(pid=124670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:55:36.562515 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-1761c267-9bfd-430b-9120-4fc95769bd14 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "DELETE /compute/v2.1/servers/284456f6-2347-46c7-bec1-2acb170b7421" status: 404 len: 111 microversion: 2.1 time: 0.031514 Jun 23 11:55:36.562515 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 563/1119] 10.222.0.13 () {58 vars in 1238 bytes} [Thu Jun 23 11:55:36 2022] DELETE /compute/v2.1/servers/284456f6-2347-46c7-bec1-2acb170b7421 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:55:36.574129 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-1a508e20-35e5-42a7-986f-8a73c5e2e0ee tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:36.574792 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-1a508e20-35e5-42a7-986f-8a73c5e2e0ee tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 284456f6-2347-46c7-bec1-2acb170b7421] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:36.581624 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-1a508e20-35e5-42a7-986f-8a73c5e2e0ee tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:36.582070 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-1a508e20-35e5-42a7-986f-8a73c5e2e0ee tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:36.582847 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-1a508e20-35e5-42a7-986f-8a73c5e2e0ee tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:36.583281 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-1a508e20-35e5-42a7-986f-8a73c5e2e0ee tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:36.597299 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.wsgi [None req-1a508e20-35e5-42a7-986f-8a73c5e2e0ee tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] HTTP exception thrown: Instance 284456f6-2347-46c7-bec1-2acb170b7421 could not be found. Jun 23 11:55:36.598834 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-1a508e20-35e5-42a7-986f-8a73c5e2e0ee tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Request method failure captured: Jun 23 11:55:36.598834 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: request: GET /compute/v2.1/servers/284456f6-2347-46c7-bec1-2acb170b7421 HTTP/1.1 Jun 23 11:55:36.598834 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Accept: application/json Jun 23 11:55:36.598834 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Accept-Encoding: identity Jun 23 11:55:36.598834 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Connection: close Jun 23 11:55:36.598834 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Content-Length: 0 Jun 23 11:55:36.598834 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Content-Type: application/json Jun 23 11:55:36.598834 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Host: 10.222.0.13 Jun 23 11:55:36.598834 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Openstack-System-Scope: None Jun 23 11:55:36.598834 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: User-Agent: python-urllib3/1.26.9 Jun 23 11:55:36.598834 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Auth-Token: gAAAAABitFIKMke7vIBbvXT2RfPc-4frmGbwTZtMddIa6SPtgPblRzRqc8HMry6yk8WPdy-omEmS4IGKEBZ0krkMZ2AKKZ3XIi6QwXYCvuOyoif5_u-lfFNTFOpNeH9m810_qoSsO3823Vbqo3_NJM0PRtSxfQcTjP265INpx0gWYDOG-d8IrtY Jun 23 11:55:36.598834 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Domain-Id: None Jun 23 11:55:36.598834 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Domain-Name: None Jun 23 11:55:36.598834 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Identity-Status: Confirmed Jun 23 11:55:36.598834 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Is-Admin-Project: True Jun 23 11:55:36.598834 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Domain-Id: default Jun 23 11:55:36.598834 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Domain-Name: Default Jun 23 11:55:36.598834 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Id: ee135767dfc846469d64b658372994a8 Jun 23 11:55:36.598834 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Name: tempest-AttachVolumeNegativeTest-213077295 Jun 23 11:55:36.598834 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Role: member,reader Jun 23 11:55:36.598834 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Roles: member,reader Jun 23 11:55:36.601292 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ee135767dfc846469d64b658372994a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ee135767dfc846469d64b658372994a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ee135767dfc846469d64b658372994a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ee135767dfc846469d64b658372994a8"}]}] Jun 23 11:55:36.601292 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant: tempest-AttachVolumeNegativeTest-213077295 Jun 23 11:55:36.601292 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant-Id: ee135767dfc846469d64b658372994a8 Jun 23 11:55:36.601292 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-213077295 Jun 23 11:55:36.601292 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User: tempest-AttachVolumeNegativeTest-213077295-project Jun 23 11:55:36.601292 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Domain-Id: default Jun 23 11:55:36.601292 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Domain-Name: Default Jun 23 11:55:36.601292 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Id: b7fd8323d29d445f903e2103453e8ae6 Jun 23 11:55:36.601292 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Name: tempest-AttachVolumeNegativeTest-213077295-project Jun 23 11:55:36.601292 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: method: > Jun 23 11:55:36.601292 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: exception: Instance 284456f6-2347-46c7-bec1-2acb170b7421 could not be found. Jun 23 11:55:36.601292 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: action_args: {'id': '284456f6-2347-46c7-bec1-2acb170b7421'} Jun 23 11:55:36.602979 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:55:36.602979 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:55:36.602979 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:55:36.602979 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:55:36.602979 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:55:36.602979 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:55:36.602979 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:55:36.602979 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:55:36.602979 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:55:36.602979 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:55:36.602979 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 284456f6-2347-46c7-bec1-2acb170b7421 could not be found. Jun 23 11:55:36.602979 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:55:36.602979 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:55:36.602979 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:55:36.602979 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:55:36.602979 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:55:36.602979 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:55:36.602979 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:55:36.602979 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:55:36.602979 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:55:36.605865 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:55:36.605865 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 11:55:36.605865 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 11:55:36.605865 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:55:36.605865 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:55:36.605865 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:55:36.605865 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:55:36.605865 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 284456f6-2347-46c7-bec1-2acb170b7421 could not be found. Jun 23 11:55:36.605865 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:55:36.605865 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:55:36.605865 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:55:36.605865 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:55:36.605865 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:55:36.605865 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:55:36.605865 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:55:36.605865 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:55:36.605865 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 284456f6-2347-46c7-bec1-2acb170b7421 could not be found. Jun 23 11:55:36.605865 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:55:36.614242 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-1a508e20-35e5-42a7-986f-8a73c5e2e0ee tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Returning 404 to user: Instance 284456f6-2347-46c7-bec1-2acb170b7421 could not be found. {{(pid=124669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:55:36.614242 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-1a508e20-35e5-42a7-986f-8a73c5e2e0ee tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/284456f6-2347-46c7-bec1-2acb170b7421" status: 404 len: 111 microversion: 2.1 time: 0.029834 Jun 23 11:55:36.614242 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 557/1120] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:36 2022] GET /compute/v2.1/servers/284456f6-2347-46c7-bec1-2acb170b7421 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:55:36.614694 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-553178c6-c602-4757-9b3c-a8fae4748547 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:36.614694 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-553178c6-c602-4757-9b3c-a8fae4748547 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 76c7fe26-3425-4f59-8a7e-4281b4b6ed3f] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:36.618085 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-553178c6-c602-4757-9b3c-a8fae4748547 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:36.618594 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-553178c6-c602-4757-9b3c-a8fae4748547 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:36.619358 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-553178c6-c602-4757-9b3c-a8fae4748547 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:36.619796 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-553178c6-c602-4757-9b3c-a8fae4748547 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:36.633292 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.wsgi [None req-553178c6-c602-4757-9b3c-a8fae4748547 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] HTTP exception thrown: Instance 76c7fe26-3425-4f59-8a7e-4281b4b6ed3f could not be found. Jun 23 11:55:36.634893 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-553178c6-c602-4757-9b3c-a8fae4748547 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Request method failure captured: Jun 23 11:55:36.634893 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: request: DELETE /compute/v2.1/servers/76c7fe26-3425-4f59-8a7e-4281b4b6ed3f HTTP/1.1 Jun 23 11:55:36.634893 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Accept: application/json Jun 23 11:55:36.634893 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Accept-Encoding: identity Jun 23 11:55:36.634893 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Connection: close Jun 23 11:55:36.634893 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Content-Length: 0 Jun 23 11:55:36.634893 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Content-Type: application/json Jun 23 11:55:36.634893 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Host: 10.222.0.13 Jun 23 11:55:36.634893 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Openstack-System-Scope: None Jun 23 11:55:36.634893 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: User-Agent: python-urllib3/1.26.9 Jun 23 11:55:36.634893 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Auth-Token: gAAAAABitFIKMke7vIBbvXT2RfPc-4frmGbwTZtMddIa6SPtgPblRzRqc8HMry6yk8WPdy-omEmS4IGKEBZ0krkMZ2AKKZ3XIi6QwXYCvuOyoif5_u-lfFNTFOpNeH9m810_qoSsO3823Vbqo3_NJM0PRtSxfQcTjP265INpx0gWYDOG-d8IrtY Jun 23 11:55:36.634893 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Domain-Id: None Jun 23 11:55:36.634893 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Domain-Name: None Jun 23 11:55:36.634893 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Identity-Status: Confirmed Jun 23 11:55:36.634893 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Is-Admin-Project: True Jun 23 11:55:36.634893 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Domain-Id: default Jun 23 11:55:36.634893 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Domain-Name: Default Jun 23 11:55:36.634893 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Id: ee135767dfc846469d64b658372994a8 Jun 23 11:55:36.634893 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Name: tempest-AttachVolumeNegativeTest-213077295 Jun 23 11:55:36.634893 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Role: member,reader Jun 23 11:55:36.634893 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Roles: member,reader Jun 23 11:55:36.636544 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ee135767dfc846469d64b658372994a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ee135767dfc846469d64b658372994a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ee135767dfc846469d64b658372994a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ee135767dfc846469d64b658372994a8"}]}] Jun 23 11:55:36.636544 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Tenant: tempest-AttachVolumeNegativeTest-213077295 Jun 23 11:55:36.636544 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Tenant-Id: ee135767dfc846469d64b658372994a8 Jun 23 11:55:36.636544 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-213077295 Jun 23 11:55:36.636544 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User: tempest-AttachVolumeNegativeTest-213077295-project Jun 23 11:55:36.636544 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Domain-Id: default Jun 23 11:55:36.636544 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Domain-Name: Default Jun 23 11:55:36.636544 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Id: b7fd8323d29d445f903e2103453e8ae6 Jun 23 11:55:36.636544 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Name: tempest-AttachVolumeNegativeTest-213077295-project Jun 23 11:55:36.636544 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: method: > Jun 23 11:55:36.636544 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: exception: Instance 76c7fe26-3425-4f59-8a7e-4281b4b6ed3f could not be found. Jun 23 11:55:36.636544 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: action_args: {'id': '76c7fe26-3425-4f59-8a7e-4281b4b6ed3f'} Jun 23 11:55:36.637338 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:55:36.637338 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:55:36.637338 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:55:36.637338 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:55:36.637338 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:55:36.637338 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:55:36.637338 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:55:36.637338 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:55:36.637338 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:55:36.637338 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:55:36.637338 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76c7fe26-3425-4f59-8a7e-4281b4b6ed3f could not be found. Jun 23 11:55:36.637338 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:55:36.637338 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:55:36.637338 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:55:36.637338 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:55:36.637338 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:55:36.637338 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:55:36.637338 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:55:36.637338 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:55:36.637338 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:55:36.638637 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:55:36.638637 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 11:55:36.638637 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 11:55:36.638637 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 11:55:36.638637 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 11:55:36.638637 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:55:36.638637 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:55:36.638637 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:55:36.638637 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:55:36.638637 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76c7fe26-3425-4f59-8a7e-4281b4b6ed3f could not be found. Jun 23 11:55:36.638637 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:55:36.638637 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:55:36.638637 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:55:36.638637 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:55:36.638637 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:55:36.638637 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:55:36.638637 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:55:36.638637 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:55:36.638637 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76c7fe26-3425-4f59-8a7e-4281b4b6ed3f could not be found. Jun 23 11:55:36.638637 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:55:36.639915 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-553178c6-c602-4757-9b3c-a8fae4748547 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Returning 404 to user: Instance 76c7fe26-3425-4f59-8a7e-4281b4b6ed3f could not be found. {{(pid=124670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:55:36.639915 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-553178c6-c602-4757-9b3c-a8fae4748547 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "DELETE /compute/v2.1/servers/76c7fe26-3425-4f59-8a7e-4281b4b6ed3f" status: 404 len: 111 microversion: 2.1 time: 0.029891 Jun 23 11:55:36.639915 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 564/1121] 10.222.0.13 () {58 vars in 1238 bytes} [Thu Jun 23 11:55:36 2022] DELETE /compute/v2.1/servers/76c7fe26-3425-4f59-8a7e-4281b4b6ed3f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:55:36.644548 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-e804bb6b-156e-47c3-b2ae-5b88b8ffc96d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:36.645157 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-e804bb6b-156e-47c3-b2ae-5b88b8ffc96d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 76c7fe26-3425-4f59-8a7e-4281b4b6ed3f] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:36.651179 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-e804bb6b-156e-47c3-b2ae-5b88b8ffc96d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:36.653311 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-e804bb6b-156e-47c3-b2ae-5b88b8ffc96d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:36.653311 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-e804bb6b-156e-47c3-b2ae-5b88b8ffc96d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:36.653311 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-e804bb6b-156e-47c3-b2ae-5b88b8ffc96d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:36.666760 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.wsgi [None req-e804bb6b-156e-47c3-b2ae-5b88b8ffc96d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] HTTP exception thrown: Instance 76c7fe26-3425-4f59-8a7e-4281b4b6ed3f could not be found. Jun 23 11:55:36.668255 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-e804bb6b-156e-47c3-b2ae-5b88b8ffc96d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Request method failure captured: Jun 23 11:55:36.668255 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: request: GET /compute/v2.1/servers/76c7fe26-3425-4f59-8a7e-4281b4b6ed3f HTTP/1.1 Jun 23 11:55:36.668255 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Accept: application/json Jun 23 11:55:36.668255 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Accept-Encoding: identity Jun 23 11:55:36.668255 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Connection: close Jun 23 11:55:36.668255 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Content-Length: 0 Jun 23 11:55:36.668255 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Content-Type: application/json Jun 23 11:55:36.668255 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Host: 10.222.0.13 Jun 23 11:55:36.668255 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Openstack-System-Scope: None Jun 23 11:55:36.668255 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: User-Agent: python-urllib3/1.26.9 Jun 23 11:55:36.668255 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Auth-Token: gAAAAABitFIKMke7vIBbvXT2RfPc-4frmGbwTZtMddIa6SPtgPblRzRqc8HMry6yk8WPdy-omEmS4IGKEBZ0krkMZ2AKKZ3XIi6QwXYCvuOyoif5_u-lfFNTFOpNeH9m810_qoSsO3823Vbqo3_NJM0PRtSxfQcTjP265INpx0gWYDOG-d8IrtY Jun 23 11:55:36.668255 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Domain-Id: None Jun 23 11:55:36.668255 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Domain-Name: None Jun 23 11:55:36.668255 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Identity-Status: Confirmed Jun 23 11:55:36.668255 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Is-Admin-Project: True Jun 23 11:55:36.668255 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Domain-Id: default Jun 23 11:55:36.668255 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Domain-Name: Default Jun 23 11:55:36.668255 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Id: ee135767dfc846469d64b658372994a8 Jun 23 11:55:36.668255 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Name: tempest-AttachVolumeNegativeTest-213077295 Jun 23 11:55:36.668255 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Role: member,reader Jun 23 11:55:36.668255 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Roles: member,reader Jun 23 11:55:36.669921 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ee135767dfc846469d64b658372994a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ee135767dfc846469d64b658372994a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ee135767dfc846469d64b658372994a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ee135767dfc846469d64b658372994a8"}]}] Jun 23 11:55:36.669921 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant: tempest-AttachVolumeNegativeTest-213077295 Jun 23 11:55:36.669921 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant-Id: ee135767dfc846469d64b658372994a8 Jun 23 11:55:36.669921 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-213077295 Jun 23 11:55:36.669921 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User: tempest-AttachVolumeNegativeTest-213077295-project Jun 23 11:55:36.669921 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Domain-Id: default Jun 23 11:55:36.669921 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Domain-Name: Default Jun 23 11:55:36.669921 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Id: b7fd8323d29d445f903e2103453e8ae6 Jun 23 11:55:36.669921 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Name: tempest-AttachVolumeNegativeTest-213077295-project Jun 23 11:55:36.669921 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: method: > Jun 23 11:55:36.669921 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: exception: Instance 76c7fe26-3425-4f59-8a7e-4281b4b6ed3f could not be found. Jun 23 11:55:36.669921 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: action_args: {'id': '76c7fe26-3425-4f59-8a7e-4281b4b6ed3f'} Jun 23 11:55:36.670863 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:55:36.670863 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:55:36.670863 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:55:36.670863 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:55:36.670863 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:55:36.670863 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:55:36.670863 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:55:36.670863 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:55:36.670863 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:55:36.670863 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:55:36.670863 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76c7fe26-3425-4f59-8a7e-4281b4b6ed3f could not be found. Jun 23 11:55:36.670863 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:55:36.670863 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:55:36.670863 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:55:36.670863 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:55:36.670863 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:55:36.670863 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:55:36.670863 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:55:36.670863 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:55:36.670863 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:55:36.677714 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:55:36.677714 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 11:55:36.677714 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 11:55:36.677714 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:55:36.677714 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:55:36.677714 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:55:36.677714 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:55:36.677714 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76c7fe26-3425-4f59-8a7e-4281b4b6ed3f could not be found. Jun 23 11:55:36.677714 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:55:36.677714 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:55:36.677714 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:55:36.677714 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:55:36.677714 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:55:36.677714 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:55:36.677714 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:55:36.677714 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:55:36.677714 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76c7fe26-3425-4f59-8a7e-4281b4b6ed3f could not be found. Jun 23 11:55:36.677714 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:55:36.679423 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-e804bb6b-156e-47c3-b2ae-5b88b8ffc96d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Returning 404 to user: Instance 76c7fe26-3425-4f59-8a7e-4281b4b6ed3f could not be found. {{(pid=124669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:55:36.679423 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-e804bb6b-156e-47c3-b2ae-5b88b8ffc96d tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/76c7fe26-3425-4f59-8a7e-4281b4b6ed3f" status: 404 len: 111 microversion: 2.1 time: 0.028987 Jun 23 11:55:36.679423 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 558/1122] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:36 2022] GET /compute/v2.1/servers/76c7fe26-3425-4f59-8a7e-4281b4b6ed3f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:55:37.335238 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-3623c5b0-38f9-44d1-8077-4b74f80be739 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:37.335732 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-3623c5b0-38f9-44d1-8077-4b74f80be739 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:37.341644 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-3623c5b0-38f9-44d1-8077-4b74f80be739 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:37.342513 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-3623c5b0-38f9-44d1-8077-4b74f80be739 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:37.342926 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-3623c5b0-38f9-44d1-8077-4b74f80be739 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:37.343357 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-3623c5b0-38f9-44d1-8077-4b74f80be739 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:37.356978 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.wsgi [None req-3623c5b0-38f9-44d1-8077-4b74f80be739 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] HTTP exception thrown: Instance 46d9d467-7a71-4e30-af82-629121319200 could not be found. Jun 23 11:55:37.358486 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-3623c5b0-38f9-44d1-8077-4b74f80be739 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Request method failure captured: Jun 23 11:55:37.358486 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: request: DELETE /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 HTTP/1.1 Jun 23 11:55:37.358486 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Accept: application/json Jun 23 11:55:37.358486 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Accept-Encoding: identity Jun 23 11:55:37.358486 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Connection: close Jun 23 11:55:37.358486 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Content-Length: 0 Jun 23 11:55:37.358486 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Content-Type: application/json Jun 23 11:55:37.358486 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Host: 10.222.0.13 Jun 23 11:55:37.358486 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Openstack-System-Scope: None Jun 23 11:55:37.358486 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: User-Agent: python-urllib3/1.26.9 Jun 23 11:55:37.358486 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Auth-Token: gAAAAABitFIUQzOKuurMnNUOBvgY4yrpwEpnJMiMRzCK2tzH0MUYk3j0socpW3oTND0Y-B0317GKEWcjAzAVg9cfaIVQTXrjnZagc0UeMsJBhfIMA6yFi6o2shaxocTT76xdSS-L5NqwUWnNEvP-ma1e0DcCmcptGshQYH5SdpjbuMIl853SdqE Jun 23 11:55:37.358486 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Domain-Id: None Jun 23 11:55:37.358486 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Domain-Name: None Jun 23 11:55:37.358486 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Identity-Status: Confirmed Jun 23 11:55:37.358486 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Is-Admin-Project: True Jun 23 11:55:37.358486 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Domain-Id: default Jun 23 11:55:37.358486 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Domain-Name: Default Jun 23 11:55:37.358486 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Id: 45db495ff8c04b55b44c80a3ab412fb9 Jun 23 11:55:37.358486 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Name: tempest-AttachVolumeTestJSON-552659924 Jun 23 11:55:37.358486 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Role: member,reader Jun 23 11:55:37.358486 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Roles: member,reader Jun 23 11:55:37.360168 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_45db495ff8c04b55b44c80a3ab412fb9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/45db495ff8c04b55b44c80a3ab412fb9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/45db495ff8c04b55b44c80a3ab412fb9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/45db495ff8c04b55b44c80a3ab412fb9"}]}] Jun 23 11:55:37.360168 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Tenant: tempest-AttachVolumeTestJSON-552659924 Jun 23 11:55:37.360168 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Tenant-Id: 45db495ff8c04b55b44c80a3ab412fb9 Jun 23 11:55:37.360168 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Tenant-Name: tempest-AttachVolumeTestJSON-552659924 Jun 23 11:55:37.360168 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User: tempest-AttachVolumeTestJSON-552659924-project Jun 23 11:55:37.360168 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Domain-Id: default Jun 23 11:55:37.360168 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Domain-Name: Default Jun 23 11:55:37.360168 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Id: d1b988f3241a46308b7c3683e2943b78 Jun 23 11:55:37.360168 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Name: tempest-AttachVolumeTestJSON-552659924-project Jun 23 11:55:37.360168 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: method: > Jun 23 11:55:37.360168 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: exception: Instance 46d9d467-7a71-4e30-af82-629121319200 could not be found. Jun 23 11:55:37.360168 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: action_args: {'id': '46d9d467-7a71-4e30-af82-629121319200'} Jun 23 11:55:37.361331 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:55:37.361331 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:55:37.361331 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:55:37.361331 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:55:37.361331 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:55:37.361331 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:55:37.361331 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:55:37.361331 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:55:37.361331 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:55:37.361331 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:55:37.361331 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46d9d467-7a71-4e30-af82-629121319200 could not be found. Jun 23 11:55:37.361331 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:55:37.361331 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:55:37.361331 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:55:37.361331 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:55:37.361331 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:55:37.361331 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:55:37.361331 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:55:37.361331 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:55:37.361331 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:55:37.362676 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:55:37.362676 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 11:55:37.362676 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 11:55:37.362676 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 11:55:37.362676 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 11:55:37.362676 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:55:37.362676 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:55:37.362676 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:55:37.362676 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:55:37.362676 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46d9d467-7a71-4e30-af82-629121319200 could not be found. Jun 23 11:55:37.362676 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:55:37.362676 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:55:37.362676 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:55:37.362676 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:55:37.362676 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:55:37.362676 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:55:37.362676 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:55:37.362676 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:55:37.362676 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46d9d467-7a71-4e30-af82-629121319200 could not be found. Jun 23 11:55:37.362676 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:55:37.365243 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-3623c5b0-38f9-44d1-8077-4b74f80be739 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Returning 404 to user: Instance 46d9d467-7a71-4e30-af82-629121319200 could not be found. {{(pid=124670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:55:37.365243 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-3623c5b0-38f9-44d1-8077-4b74f80be739 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "DELETE /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 404 len: 111 microversion: 2.1 time: 0.028649 Jun 23 11:55:37.365243 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 565/1123] 10.222.0.13 () {58 vars in 1238 bytes} [Thu Jun 23 11:55:37 2022] DELETE /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:55:37.369512 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-2fb2b435-4948-4a89-b35c-e52f7500d0e9 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:37.370127 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-2fb2b435-4948-4a89-b35c-e52f7500d0e9 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] [instance: 46d9d467-7a71-4e30-af82-629121319200] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:37.376717 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-2fb2b435-4948-4a89-b35c-e52f7500d0e9 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:37.377172 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-2fb2b435-4948-4a89-b35c-e52f7500d0e9 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:37.377930 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-2fb2b435-4948-4a89-b35c-e52f7500d0e9 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:37.378364 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-2fb2b435-4948-4a89-b35c-e52f7500d0e9 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:37.392612 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.wsgi [None req-2fb2b435-4948-4a89-b35c-e52f7500d0e9 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] HTTP exception thrown: Instance 46d9d467-7a71-4e30-af82-629121319200 could not be found. Jun 23 11:55:37.394149 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-2fb2b435-4948-4a89-b35c-e52f7500d0e9 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Request method failure captured: Jun 23 11:55:37.394149 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: request: GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 HTTP/1.1 Jun 23 11:55:37.394149 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Accept: application/json Jun 23 11:55:37.394149 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Accept-Encoding: identity Jun 23 11:55:37.394149 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Connection: close Jun 23 11:55:37.394149 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Content-Length: 0 Jun 23 11:55:37.394149 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Content-Type: application/json Jun 23 11:55:37.394149 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Host: 10.222.0.13 Jun 23 11:55:37.394149 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Openstack-System-Scope: None Jun 23 11:55:37.394149 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: User-Agent: python-urllib3/1.26.9 Jun 23 11:55:37.394149 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Auth-Token: gAAAAABitFIUQzOKuurMnNUOBvgY4yrpwEpnJMiMRzCK2tzH0MUYk3j0socpW3oTND0Y-B0317GKEWcjAzAVg9cfaIVQTXrjnZagc0UeMsJBhfIMA6yFi6o2shaxocTT76xdSS-L5NqwUWnNEvP-ma1e0DcCmcptGshQYH5SdpjbuMIl853SdqE Jun 23 11:55:37.394149 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Domain-Id: None Jun 23 11:55:37.394149 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Domain-Name: None Jun 23 11:55:37.394149 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Identity-Status: Confirmed Jun 23 11:55:37.394149 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Is-Admin-Project: True Jun 23 11:55:37.394149 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Domain-Id: default Jun 23 11:55:37.394149 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Domain-Name: Default Jun 23 11:55:37.394149 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Id: 45db495ff8c04b55b44c80a3ab412fb9 Jun 23 11:55:37.394149 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Name: tempest-AttachVolumeTestJSON-552659924 Jun 23 11:55:37.394149 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Role: member,reader Jun 23 11:55:37.394149 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Roles: member,reader Jun 23 11:55:37.395829 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_45db495ff8c04b55b44c80a3ab412fb9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/45db495ff8c04b55b44c80a3ab412fb9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/45db495ff8c04b55b44c80a3ab412fb9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/45db495ff8c04b55b44c80a3ab412fb9"}]}] Jun 23 11:55:37.395829 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant: tempest-AttachVolumeTestJSON-552659924 Jun 23 11:55:37.395829 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant-Id: 45db495ff8c04b55b44c80a3ab412fb9 Jun 23 11:55:37.395829 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant-Name: tempest-AttachVolumeTestJSON-552659924 Jun 23 11:55:37.395829 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User: tempest-AttachVolumeTestJSON-552659924-project Jun 23 11:55:37.395829 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Domain-Id: default Jun 23 11:55:37.395829 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Domain-Name: Default Jun 23 11:55:37.395829 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Id: d1b988f3241a46308b7c3683e2943b78 Jun 23 11:55:37.395829 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Name: tempest-AttachVolumeTestJSON-552659924-project Jun 23 11:55:37.395829 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: method: > Jun 23 11:55:37.395829 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: exception: Instance 46d9d467-7a71-4e30-af82-629121319200 could not be found. Jun 23 11:55:37.395829 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: action_args: {'id': '46d9d467-7a71-4e30-af82-629121319200'} Jun 23 11:55:37.396731 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:55:37.396731 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:55:37.396731 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:55:37.396731 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:55:37.396731 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:55:37.396731 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:55:37.396731 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:55:37.396731 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:55:37.396731 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:55:37.396731 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:55:37.396731 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46d9d467-7a71-4e30-af82-629121319200 could not be found. Jun 23 11:55:37.396731 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:55:37.396731 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:55:37.396731 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:55:37.396731 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:55:37.396731 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:55:37.396731 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:55:37.396731 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:55:37.396731 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:55:37.396731 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:55:37.398213 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:55:37.398213 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 11:55:37.398213 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 11:55:37.398213 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:55:37.398213 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:55:37.398213 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:55:37.398213 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:55:37.398213 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46d9d467-7a71-4e30-af82-629121319200 could not be found. Jun 23 11:55:37.398213 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:55:37.398213 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:55:37.398213 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:55:37.398213 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:55:37.398213 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:55:37.398213 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:55:37.398213 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:55:37.398213 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:55:37.398213 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46d9d467-7a71-4e30-af82-629121319200 could not be found. Jun 23 11:55:37.398213 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:55:37.399527 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-2fb2b435-4948-4a89-b35c-e52f7500d0e9 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] Returning 404 to user: Instance 46d9d467-7a71-4e30-af82-629121319200 could not be found. {{(pid=124669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:55:37.399527 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-2fb2b435-4948-4a89-b35c-e52f7500d0e9 tempest-AttachVolumeTestJSON-552659924 tempest-AttachVolumeTestJSON-552659924-project] 10.222.0.13 "GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200" status: 404 len: 111 microversion: 2.1 time: 0.030438 Jun 23 11:55:37.399527 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 559/1124] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:37 2022] GET /compute/v2.1/servers/46d9d467-7a71-4e30-af82-629121319200 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:55:37.901633 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-ba0189aa-64fa-4847-aeb3-2d9b96e211d9 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:37.902252 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-ba0189aa-64fa-4847-aeb3-2d9b96e211d9 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 250e2ce6-70ad-4082-8073-6a9cea0ca1e4] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:37.909656 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-ba0189aa-64fa-4847-aeb3-2d9b96e211d9 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:37.910204 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-ba0189aa-64fa-4847-aeb3-2d9b96e211d9 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:37.911001 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-ba0189aa-64fa-4847-aeb3-2d9b96e211d9 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:37.911437 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-ba0189aa-64fa-4847-aeb3-2d9b96e211d9 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:37.925787 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.wsgi [None req-ba0189aa-64fa-4847-aeb3-2d9b96e211d9 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] HTTP exception thrown: Instance 250e2ce6-70ad-4082-8073-6a9cea0ca1e4 could not be found. Jun 23 11:55:37.927356 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-ba0189aa-64fa-4847-aeb3-2d9b96e211d9 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Request method failure captured: Jun 23 11:55:37.927356 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: request: DELETE /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4 HTTP/1.1 Jun 23 11:55:37.927356 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Accept: application/json Jun 23 11:55:37.927356 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Accept-Encoding: identity Jun 23 11:55:37.927356 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Connection: close Jun 23 11:55:37.927356 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Content-Length: 0 Jun 23 11:55:37.927356 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Content-Type: application/json Jun 23 11:55:37.927356 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Host: 10.222.0.13 Jun 23 11:55:37.927356 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Openstack-System-Scope: None Jun 23 11:55:37.927356 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: User-Agent: python-urllib3/1.26.9 Jun 23 11:55:37.927356 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Auth-Token: gAAAAABitFIKMke7vIBbvXT2RfPc-4frmGbwTZtMddIa6SPtgPblRzRqc8HMry6yk8WPdy-omEmS4IGKEBZ0krkMZ2AKKZ3XIi6QwXYCvuOyoif5_u-lfFNTFOpNeH9m810_qoSsO3823Vbqo3_NJM0PRtSxfQcTjP265INpx0gWYDOG-d8IrtY Jun 23 11:55:37.927356 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Domain-Id: None Jun 23 11:55:37.927356 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Domain-Name: None Jun 23 11:55:37.927356 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Identity-Status: Confirmed Jun 23 11:55:37.927356 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Is-Admin-Project: True Jun 23 11:55:37.927356 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Domain-Id: default Jun 23 11:55:37.927356 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Domain-Name: Default Jun 23 11:55:37.927356 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Id: ee135767dfc846469d64b658372994a8 Jun 23 11:55:37.927356 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Name: tempest-AttachVolumeNegativeTest-213077295 Jun 23 11:55:37.927356 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Role: member,reader Jun 23 11:55:37.927356 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Roles: member,reader Jun 23 11:55:37.929024 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ee135767dfc846469d64b658372994a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ee135767dfc846469d64b658372994a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ee135767dfc846469d64b658372994a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ee135767dfc846469d64b658372994a8"}]}] Jun 23 11:55:37.929024 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Tenant: tempest-AttachVolumeNegativeTest-213077295 Jun 23 11:55:37.929024 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Tenant-Id: ee135767dfc846469d64b658372994a8 Jun 23 11:55:37.929024 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-213077295 Jun 23 11:55:37.929024 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User: tempest-AttachVolumeNegativeTest-213077295-project Jun 23 11:55:37.929024 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Domain-Id: default Jun 23 11:55:37.929024 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Domain-Name: Default Jun 23 11:55:37.929024 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Id: b7fd8323d29d445f903e2103453e8ae6 Jun 23 11:55:37.929024 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Name: tempest-AttachVolumeNegativeTest-213077295-project Jun 23 11:55:37.929024 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: method: > Jun 23 11:55:37.929024 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: exception: Instance 250e2ce6-70ad-4082-8073-6a9cea0ca1e4 could not be found. Jun 23 11:55:37.929024 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: action_args: {'id': '250e2ce6-70ad-4082-8073-6a9cea0ca1e4'} Jun 23 11:55:37.932834 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:55:37.932834 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:55:37.932834 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:55:37.932834 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:55:37.932834 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:55:37.932834 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:55:37.932834 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:55:37.932834 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:55:37.932834 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:55:37.932834 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:55:37.932834 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 250e2ce6-70ad-4082-8073-6a9cea0ca1e4 could not be found. Jun 23 11:55:37.932834 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:55:37.932834 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:55:37.932834 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:55:37.932834 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:55:37.932834 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:55:37.932834 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:55:37.932834 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:55:37.932834 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:55:37.932834 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:55:37.934382 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:55:37.934382 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 11:55:37.934382 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 11:55:37.934382 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 11:55:37.934382 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 11:55:37.934382 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:55:37.934382 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:55:37.934382 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:55:37.934382 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:55:37.934382 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 250e2ce6-70ad-4082-8073-6a9cea0ca1e4 could not be found. Jun 23 11:55:37.934382 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:55:37.934382 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:55:37.934382 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:55:37.934382 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:55:37.934382 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:55:37.934382 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:55:37.934382 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:55:37.934382 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:55:37.934382 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 250e2ce6-70ad-4082-8073-6a9cea0ca1e4 could not be found. Jun 23 11:55:37.934382 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:55:37.935927 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-ba0189aa-64fa-4847-aeb3-2d9b96e211d9 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Returning 404 to user: Instance 250e2ce6-70ad-4082-8073-6a9cea0ca1e4 could not be found. {{(pid=124670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:55:37.935927 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-ba0189aa-64fa-4847-aeb3-2d9b96e211d9 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "DELETE /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4" status: 404 len: 111 microversion: 2.1 time: 0.031039 Jun 23 11:55:37.935927 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 566/1125] 10.222.0.13 () {58 vars in 1238 bytes} [Thu Jun 23 11:55:37 2022] DELETE /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:55:37.941871 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-193c8dff-3fda-44fb-b7cb-675d61d922a0 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:37.942483 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-193c8dff-3fda-44fb-b7cb-675d61d922a0 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] [instance: 250e2ce6-70ad-4082-8073-6a9cea0ca1e4] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:37.949202 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-193c8dff-3fda-44fb-b7cb-675d61d922a0 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:37.949653 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-193c8dff-3fda-44fb-b7cb-675d61d922a0 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:37.950412 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-193c8dff-3fda-44fb-b7cb-675d61d922a0 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:37.950867 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-193c8dff-3fda-44fb-b7cb-675d61d922a0 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:37.964915 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.wsgi [None req-193c8dff-3fda-44fb-b7cb-675d61d922a0 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] HTTP exception thrown: Instance 250e2ce6-70ad-4082-8073-6a9cea0ca1e4 could not be found. Jun 23 11:55:37.966457 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-193c8dff-3fda-44fb-b7cb-675d61d922a0 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Request method failure captured: Jun 23 11:55:37.966457 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: request: GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4 HTTP/1.1 Jun 23 11:55:37.966457 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Accept: application/json Jun 23 11:55:37.966457 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Accept-Encoding: identity Jun 23 11:55:37.966457 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Connection: close Jun 23 11:55:37.966457 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Content-Length: 0 Jun 23 11:55:37.966457 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Content-Type: application/json Jun 23 11:55:37.966457 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Host: 10.222.0.13 Jun 23 11:55:37.966457 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Openstack-System-Scope: None Jun 23 11:55:37.966457 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: User-Agent: python-urllib3/1.26.9 Jun 23 11:55:37.966457 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Auth-Token: gAAAAABitFIKMke7vIBbvXT2RfPc-4frmGbwTZtMddIa6SPtgPblRzRqc8HMry6yk8WPdy-omEmS4IGKEBZ0krkMZ2AKKZ3XIi6QwXYCvuOyoif5_u-lfFNTFOpNeH9m810_qoSsO3823Vbqo3_NJM0PRtSxfQcTjP265INpx0gWYDOG-d8IrtY Jun 23 11:55:37.966457 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Domain-Id: None Jun 23 11:55:37.966457 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Domain-Name: None Jun 23 11:55:37.966457 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Identity-Status: Confirmed Jun 23 11:55:37.966457 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Is-Admin-Project: True Jun 23 11:55:37.966457 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Domain-Id: default Jun 23 11:55:37.966457 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Domain-Name: Default Jun 23 11:55:37.966457 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Id: ee135767dfc846469d64b658372994a8 Jun 23 11:55:37.966457 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Name: tempest-AttachVolumeNegativeTest-213077295 Jun 23 11:55:37.966457 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Role: member,reader Jun 23 11:55:37.966457 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Roles: member,reader Jun 23 11:55:37.968111 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ee135767dfc846469d64b658372994a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ee135767dfc846469d64b658372994a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ee135767dfc846469d64b658372994a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ee135767dfc846469d64b658372994a8"}]}] Jun 23 11:55:37.968111 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant: tempest-AttachVolumeNegativeTest-213077295 Jun 23 11:55:37.968111 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant-Id: ee135767dfc846469d64b658372994a8 Jun 23 11:55:37.968111 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-213077295 Jun 23 11:55:37.968111 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User: tempest-AttachVolumeNegativeTest-213077295-project Jun 23 11:55:37.968111 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Domain-Id: default Jun 23 11:55:37.968111 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Domain-Name: Default Jun 23 11:55:37.968111 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Id: b7fd8323d29d445f903e2103453e8ae6 Jun 23 11:55:37.968111 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Name: tempest-AttachVolumeNegativeTest-213077295-project Jun 23 11:55:37.968111 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: method: > Jun 23 11:55:37.968111 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: exception: Instance 250e2ce6-70ad-4082-8073-6a9cea0ca1e4 could not be found. Jun 23 11:55:37.968111 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: action_args: {'id': '250e2ce6-70ad-4082-8073-6a9cea0ca1e4'} Jun 23 11:55:37.969197 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:55:37.969197 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:55:37.969197 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:55:37.969197 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:55:37.969197 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:55:37.969197 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:55:37.969197 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:55:37.969197 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:55:37.969197 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:55:37.969197 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:55:37.969197 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 250e2ce6-70ad-4082-8073-6a9cea0ca1e4 could not be found. Jun 23 11:55:37.969197 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:55:37.969197 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:55:37.969197 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:55:37.969197 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:55:37.969197 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:55:37.969197 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:55:37.969197 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:55:37.969197 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:55:37.969197 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:55:37.970784 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:55:37.970784 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 11:55:37.970784 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 11:55:37.970784 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:55:37.970784 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:55:37.970784 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:55:37.970784 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:55:37.970784 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 250e2ce6-70ad-4082-8073-6a9cea0ca1e4 could not be found. Jun 23 11:55:37.970784 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:55:37.970784 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:55:37.970784 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:55:37.970784 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:55:37.970784 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:55:37.970784 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:55:37.970784 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:55:37.970784 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:55:37.970784 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 250e2ce6-70ad-4082-8073-6a9cea0ca1e4 could not be found. Jun 23 11:55:37.970784 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:55:37.972109 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-193c8dff-3fda-44fb-b7cb-675d61d922a0 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] Returning 404 to user: Instance 250e2ce6-70ad-4082-8073-6a9cea0ca1e4 could not be found. {{(pid=124669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:55:37.972109 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-193c8dff-3fda-44fb-b7cb-675d61d922a0 tempest-AttachVolumeNegativeTest-213077295 tempest-AttachVolumeNegativeTest-213077295-project] 10.222.0.13 "GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4" status: 404 len: 111 microversion: 2.1 time: 0.030573 Jun 23 11:55:37.972109 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 560/1126] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:37 2022] GET /compute/v2.1/servers/250e2ce6-70ad-4082-8073-6a9cea0ca1e4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:55:43.708585 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-527646ac-6e55-443b-b8a4-68e9aeaa741b tempest-VolumesNegativeTest-930873315 tempest-VolumesNegativeTest-930873315-project] Action: 'create', calling method: .version_select at 0x7f5d067b9b80>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-999434470", "metadata": {"Type": "work"}}} {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:55:43.730902 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-527646ac-6e55-443b-b8a4-68e9aeaa741b tempest-VolumesNegativeTest-930873315 tempest-VolumesNegativeTest-930873315-project] Request method failure captured: Jun 23 11:55:43.730902 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 23 11:55:43.730902 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Accept: application/json Jun 23 11:55:43.730902 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Accept-Encoding: identity Jun 23 11:55:43.730902 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Connection: close Jun 23 11:55:43.730902 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Content-Length: 121 Jun 23 11:55:43.730902 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Content-Type: application/json Jun 23 11:55:43.730902 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Host: 10.222.0.13 Jun 23 11:55:43.730902 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Openstack-System-Scope: None Jun 23 11:55:43.730902 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: User-Agent: python-urllib3/1.26.9 Jun 23 11:55:43.730902 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Auth-Token: gAAAAABitFS_yJTyvknyLuj6CLxvk62WTqsFCK4nZdxQT5spwte0ye4n5o2vmM6cq8RpzXZm1BLIJn_jBbUgQKhZCgP69k4I9R4MpvrUApnQklgV1bdbJxlgNKnuqLdsAcrQonuGJW_-gPKgYr2Xu71QqZhfI2-eURYRlNz7C1-XGt9C8SaBzoQ Jun 23 11:55:43.730902 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Domain-Id: None Jun 23 11:55:43.730902 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Domain-Name: None Jun 23 11:55:43.730902 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Identity-Status: Confirmed Jun 23 11:55:43.730902 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Is-Admin-Project: True Jun 23 11:55:43.730902 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Domain-Id: default Jun 23 11:55:43.730902 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Domain-Name: Default Jun 23 11:55:43.730902 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Id: fd8e176b4c9b4898ae5fc3b201e86e04 Jun 23 11:55:43.730902 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Name: tempest-VolumesNegativeTest-930873315 Jun 23 11:55:43.730902 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Role: member,reader Jun 23 11:55:43.730902 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Roles: member,reader Jun 23 11:55:43.732846 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_fd8e176b4c9b4898ae5fc3b201e86e04"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/fd8e176b4c9b4898ae5fc3b201e86e04"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/fd8e176b4c9b4898ae5fc3b201e86e04"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/fd8e176b4c9b4898ae5fc3b201e86e04"}]}] Jun 23 11:55:43.732846 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Tenant: tempest-VolumesNegativeTest-930873315 Jun 23 11:55:43.732846 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Tenant-Id: fd8e176b4c9b4898ae5fc3b201e86e04 Jun 23 11:55:43.732846 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Tenant-Name: tempest-VolumesNegativeTest-930873315 Jun 23 11:55:43.732846 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User: tempest-VolumesNegativeTest-930873315-project Jun 23 11:55:43.732846 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Domain-Id: default Jun 23 11:55:43.732846 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Domain-Name: Default Jun 23 11:55:43.732846 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Id: 87d269c842ac4f01bfa19335784a7c57 Jun 23 11:55:43.732846 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Name: tempest-VolumesNegativeTest-930873315-project Jun 23 11:55:43.732846 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Jun 23 11:55:43.732846 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-999434470", "metadata": {"Type": "work"}}} Jun 23 11:55:43.732846 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: method: Jun 23 11:55:43.732846 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 23 11:55:43.734111 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-999434470', 'metadata': {'Type': 'work'}}}} Jun 23 11:55:43.734111 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:55:43.734111 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:55:43.734111 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 23 11:55:43.734111 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 23 11:55:43.734111 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 23 11:55:43.734111 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi raise error Jun 23 11:55:43.734111 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 23 11:55:43.734111 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:55:43.734111 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 23 11:55:43.734111 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 23 11:55:43.734111 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:55:43.734111 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 23 11:55:43.734111 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi '#$%' Jun 23 11:55:43.734111 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:55:43.734111 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:55:43.734111 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:55:43.734111 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:55:43.734111 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:55:43.734111 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:55:43.734111 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:55:43.734111 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:55:43.736296 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 11:55:43.736296 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 11:55:43.736296 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:55:43.736296 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:55:43.736296 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 23 11:55:43.736296 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 23 11:55:43.736296 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 23 11:55:43.736296 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 23 11:55:43.736296 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 23 11:55:43.736296 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 23 11:55:43.736296 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 23 11:55:43.736296 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:55:43.736296 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:55:43.736296 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:55:43.736296 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:55:43.736296 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:55:43.736296 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:55:43.736296 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 23 11:55:43.736296 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 23 11:55:43.737740 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 23 11:55:43.737740 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:55:43.737740 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-527646ac-6e55-443b-b8a4-68e9aeaa741b tempest-VolumesNegativeTest-930873315 tempest-VolumesNegativeTest-930873315-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:55:43.737740 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-527646ac-6e55-443b-b8a4-68e9aeaa741b tempest-VolumesNegativeTest-930873315 tempest-VolumesNegativeTest-930873315-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.248214 Jun 23 11:55:43.737740 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 567/1127] 10.222.0.13 () {60 vars in 1155 bytes} [Thu Jun 23 11:55:43 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 249 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 23 11:55:43.743952 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-13726841-6d94-4b0b-98c4-19179d5b62d6 tempest-VolumesNegativeTest-930873315 tempest-VolumesNegativeTest-930873315-project] Action: 'create', calling method: .version_select at 0x7f5d06fa8550>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-832989950", "metadata": {"Type": "work"}}} {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:55:43.747641 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-13726841-6d94-4b0b-98c4-19179d5b62d6 tempest-VolumesNegativeTest-930873315 tempest-VolumesNegativeTest-930873315-project] Request method failure captured: Jun 23 11:55:43.747641 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 23 11:55:43.747641 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Accept: application/json Jun 23 11:55:43.747641 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Accept-Encoding: identity Jun 23 11:55:43.747641 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Connection: close Jun 23 11:55:43.747641 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Content-Length: 119 Jun 23 11:55:43.747641 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Content-Type: application/json Jun 23 11:55:43.747641 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Host: 10.222.0.13 Jun 23 11:55:43.747641 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Openstack-System-Scope: None Jun 23 11:55:43.747641 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: User-Agent: python-urllib3/1.26.9 Jun 23 11:55:43.747641 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Auth-Token: gAAAAABitFS_yJTyvknyLuj6CLxvk62WTqsFCK4nZdxQT5spwte0ye4n5o2vmM6cq8RpzXZm1BLIJn_jBbUgQKhZCgP69k4I9R4MpvrUApnQklgV1bdbJxlgNKnuqLdsAcrQonuGJW_-gPKgYr2Xu71QqZhfI2-eURYRlNz7C1-XGt9C8SaBzoQ Jun 23 11:55:43.747641 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Domain-Id: None Jun 23 11:55:43.747641 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Domain-Name: None Jun 23 11:55:43.747641 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Identity-Status: Confirmed Jun 23 11:55:43.747641 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Is-Admin-Project: True Jun 23 11:55:43.747641 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Domain-Id: default Jun 23 11:55:43.747641 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Domain-Name: Default Jun 23 11:55:43.747641 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Id: fd8e176b4c9b4898ae5fc3b201e86e04 Jun 23 11:55:43.747641 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Name: tempest-VolumesNegativeTest-930873315 Jun 23 11:55:43.747641 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Role: member,reader Jun 23 11:55:43.747641 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Roles: member,reader Jun 23 11:55:43.760537 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_fd8e176b4c9b4898ae5fc3b201e86e04"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/fd8e176b4c9b4898ae5fc3b201e86e04"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/fd8e176b4c9b4898ae5fc3b201e86e04"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/fd8e176b4c9b4898ae5fc3b201e86e04"}]}] Jun 23 11:55:43.760537 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant: tempest-VolumesNegativeTest-930873315 Jun 23 11:55:43.760537 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant-Id: fd8e176b4c9b4898ae5fc3b201e86e04 Jun 23 11:55:43.760537 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant-Name: tempest-VolumesNegativeTest-930873315 Jun 23 11:55:43.760537 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User: tempest-VolumesNegativeTest-930873315-project Jun 23 11:55:43.760537 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Domain-Id: default Jun 23 11:55:43.760537 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Domain-Name: Default Jun 23 11:55:43.760537 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Id: 87d269c842ac4f01bfa19335784a7c57 Jun 23 11:55:43.760537 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Name: tempest-VolumesNegativeTest-930873315-project Jun 23 11:55:43.760537 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Jun 23 11:55:43.760537 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-832989950", "metadata": {"Type": "work"}}} Jun 23 11:55:43.760537 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: method: Jun 23 11:55:43.760537 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 23 11:55:43.761613 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-832989950', 'metadata': {'Type': 'work'}}}} Jun 23 11:55:43.761613 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:55:43.761613 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:55:43.761613 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 23 11:55:43.761613 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 23 11:55:43.761613 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 23 11:55:43.761613 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise error Jun 23 11:55:43.761613 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 23 11:55:43.761613 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:55:43.761613 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 23 11:55:43.761613 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 23 11:55:43.761613 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:55:43.761613 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 23 11:55:43.761613 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi '0' Jun 23 11:55:43.761613 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:55:43.761613 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:55:43.761613 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:55:43.761613 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:55:43.761613 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:55:43.761613 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:55:43.761613 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:55:43.761613 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:55:43.763474 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 11:55:43.763474 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 11:55:43.763474 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:55:43.763474 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:55:43.763474 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 23 11:55:43.763474 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 23 11:55:43.763474 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 23 11:55:43.763474 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 23 11:55:43.763474 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 23 11:55:43.763474 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 23 11:55:43.763474 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 23 11:55:43.763474 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:55:43.763474 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:55:43.763474 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:55:43.763474 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:55:43.763474 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:55:43.763474 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:55:43.763474 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 23 11:55:43.763474 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 23 11:55:43.764978 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 23 11:55:43.764978 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:55:43.764978 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-13726841-6d94-4b0b-98c4-19179d5b62d6 tempest-VolumesNegativeTest-930873315 tempest-VolumesNegativeTest-930873315-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:55:43.764978 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-13726841-6d94-4b0b-98c4-19179d5b62d6 tempest-VolumesNegativeTest-930873315 tempest-VolumesNegativeTest-930873315-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009390 Jun 23 11:55:43.764978 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 561/1128] 10.222.0.13 () {60 vars in 1155 bytes} [Thu Jun 23 11:55:43 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 23 11:55:43.769048 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-ee11300f-6e07-4675-a9e1-4f83a921c633 tempest-VolumesNegativeTest-930873315 tempest-VolumesNegativeTest-930873315-project] Action: 'create', calling method: .version_select at 0x7f5d0af1a820>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1384051040", "metadata": {"Type": "work"}}} {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:55:43.773750 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-ee11300f-6e07-4675-a9e1-4f83a921c633 tempest-VolumesNegativeTest-930873315 tempest-VolumesNegativeTest-930873315-project] Request method failure captured: Jun 23 11:55:43.773750 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 23 11:55:43.773750 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Accept: application/json Jun 23 11:55:43.773750 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Accept-Encoding: identity Jun 23 11:55:43.773750 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Connection: close Jun 23 11:55:43.773750 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Content-Length: 119 Jun 23 11:55:43.773750 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Content-Type: application/json Jun 23 11:55:43.773750 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Host: 10.222.0.13 Jun 23 11:55:43.773750 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Openstack-System-Scope: None Jun 23 11:55:43.773750 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: User-Agent: python-urllib3/1.26.9 Jun 23 11:55:43.773750 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Auth-Token: gAAAAABitFS_yJTyvknyLuj6CLxvk62WTqsFCK4nZdxQT5spwte0ye4n5o2vmM6cq8RpzXZm1BLIJn_jBbUgQKhZCgP69k4I9R4MpvrUApnQklgV1bdbJxlgNKnuqLdsAcrQonuGJW_-gPKgYr2Xu71QqZhfI2-eURYRlNz7C1-XGt9C8SaBzoQ Jun 23 11:55:43.773750 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Domain-Id: None Jun 23 11:55:43.773750 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Domain-Name: None Jun 23 11:55:43.773750 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Identity-Status: Confirmed Jun 23 11:55:43.773750 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Is-Admin-Project: True Jun 23 11:55:43.773750 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Domain-Id: default Jun 23 11:55:43.773750 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Domain-Name: Default Jun 23 11:55:43.773750 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Id: fd8e176b4c9b4898ae5fc3b201e86e04 Jun 23 11:55:43.773750 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Name: tempest-VolumesNegativeTest-930873315 Jun 23 11:55:43.773750 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Role: member,reader Jun 23 11:55:43.773750 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Roles: member,reader Jun 23 11:55:43.777190 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_fd8e176b4c9b4898ae5fc3b201e86e04"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/fd8e176b4c9b4898ae5fc3b201e86e04"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/fd8e176b4c9b4898ae5fc3b201e86e04"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/fd8e176b4c9b4898ae5fc3b201e86e04"}]}] Jun 23 11:55:43.777190 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Tenant: tempest-VolumesNegativeTest-930873315 Jun 23 11:55:43.777190 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Tenant-Id: fd8e176b4c9b4898ae5fc3b201e86e04 Jun 23 11:55:43.777190 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Tenant-Name: tempest-VolumesNegativeTest-930873315 Jun 23 11:55:43.777190 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User: tempest-VolumesNegativeTest-930873315-project Jun 23 11:55:43.777190 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Domain-Id: default Jun 23 11:55:43.777190 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Domain-Name: Default Jun 23 11:55:43.777190 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Id: 87d269c842ac4f01bfa19335784a7c57 Jun 23 11:55:43.777190 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Name: tempest-VolumesNegativeTest-930873315-project Jun 23 11:55:43.777190 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Jun 23 11:55:43.777190 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1384051040", "metadata": {"Type": "work"}}} Jun 23 11:55:43.777190 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: method: Jun 23 11:55:43.777190 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 23 11:55:43.779454 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1384051040', 'metadata': {'Type': 'work'}}}} Jun 23 11:55:43.779454 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:55:43.779454 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:55:43.779454 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 23 11:55:43.779454 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 23 11:55:43.779454 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 23 11:55:43.779454 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi raise error Jun 23 11:55:43.779454 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 23 11:55:43.779454 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:55:43.779454 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 23 11:55:43.779454 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 23 11:55:43.779454 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:55:43.779454 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 23 11:55:43.779454 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi '' Jun 23 11:55:43.779454 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:55:43.779454 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:55:43.779454 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:55:43.779454 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:55:43.779454 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:55:43.779454 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:55:43.779454 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:55:43.779454 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:55:43.780959 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 11:55:43.780959 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 11:55:43.780959 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:55:43.780959 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:55:43.780959 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 23 11:55:43.780959 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 23 11:55:43.780959 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 23 11:55:43.780959 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 23 11:55:43.780959 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 23 11:55:43.780959 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 23 11:55:43.780959 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 23 11:55:43.780959 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:55:43.780959 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:55:43.780959 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:55:43.780959 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:55:43.780959 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:55:43.780959 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:55:43.780959 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 23 11:55:43.780959 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 23 11:55:43.782134 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 23 11:55:43.782134 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:55:43.782134 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-ee11300f-6e07-4675-a9e1-4f83a921c633 tempest-VolumesNegativeTest-930873315 tempest-VolumesNegativeTest-930873315-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:55:43.782134 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-ee11300f-6e07-4675-a9e1-4f83a921c633 tempest-VolumesNegativeTest-930873315 tempest-VolumesNegativeTest-930873315-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010897 Jun 23 11:55:43.782134 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 568/1129] 10.222.0.13 () {60 vars in 1155 bytes} [Thu Jun 23 11:55:43 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 23 11:55:43.786092 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-2a8e7866-583e-47f6-a48d-ad89263b9a17 tempest-VolumesNegativeTest-930873315 tempest-VolumesNegativeTest-930873315-project] Calling method '.version_select at 0x7f5d070d99d0>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:43.819155 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.wsgi [None req-2a8e7866-583e-47f6-a48d-ad89263b9a17 tempest-VolumesNegativeTest-930873315 tempest-VolumesNegativeTest-930873315-project] HTTP exception thrown: Volume tempest-invalid-198921624 could not be found. Jun 23 11:55:43.821137 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-2a8e7866-583e-47f6-a48d-ad89263b9a17 tempest-VolumesNegativeTest-930873315 tempest-VolumesNegativeTest-930873315-project] Request method failure captured: Jun 23 11:55:43.821137 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-198921624 HTTP/1.1 Jun 23 11:55:43.821137 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Accept: application/json Jun 23 11:55:43.821137 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Accept-Encoding: identity Jun 23 11:55:43.821137 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Connection: close Jun 23 11:55:43.821137 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Content-Length: 0 Jun 23 11:55:43.821137 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Content-Type: application/json Jun 23 11:55:43.821137 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Host: 10.222.0.13 Jun 23 11:55:43.821137 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Openstack-System-Scope: None Jun 23 11:55:43.821137 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: User-Agent: python-urllib3/1.26.9 Jun 23 11:55:43.821137 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Auth-Token: gAAAAABitFS_yJTyvknyLuj6CLxvk62WTqsFCK4nZdxQT5spwte0ye4n5o2vmM6cq8RpzXZm1BLIJn_jBbUgQKhZCgP69k4I9R4MpvrUApnQklgV1bdbJxlgNKnuqLdsAcrQonuGJW_-gPKgYr2Xu71QqZhfI2-eURYRlNz7C1-XGt9C8SaBzoQ Jun 23 11:55:43.821137 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Domain-Id: None Jun 23 11:55:43.821137 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Domain-Name: None Jun 23 11:55:43.821137 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Identity-Status: Confirmed Jun 23 11:55:43.821137 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Is-Admin-Project: True Jun 23 11:55:43.821137 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Domain-Id: default Jun 23 11:55:43.821137 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Domain-Name: Default Jun 23 11:55:43.821137 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Id: fd8e176b4c9b4898ae5fc3b201e86e04 Jun 23 11:55:43.821137 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Name: tempest-VolumesNegativeTest-930873315 Jun 23 11:55:43.821137 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Role: member,reader Jun 23 11:55:43.821137 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Roles: member,reader Jun 23 11:55:43.822706 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_fd8e176b4c9b4898ae5fc3b201e86e04"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/fd8e176b4c9b4898ae5fc3b201e86e04"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/fd8e176b4c9b4898ae5fc3b201e86e04"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/fd8e176b4c9b4898ae5fc3b201e86e04"}]}] Jun 23 11:55:43.822706 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant: tempest-VolumesNegativeTest-930873315 Jun 23 11:55:43.822706 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant-Id: fd8e176b4c9b4898ae5fc3b201e86e04 Jun 23 11:55:43.822706 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant-Name: tempest-VolumesNegativeTest-930873315 Jun 23 11:55:43.822706 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User: tempest-VolumesNegativeTest-930873315-project Jun 23 11:55:43.822706 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Domain-Id: default Jun 23 11:55:43.822706 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Domain-Name: Default Jun 23 11:55:43.822706 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Id: 87d269c842ac4f01bfa19335784a7c57 Jun 23 11:55:43.822706 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Name: tempest-VolumesNegativeTest-930873315-project Jun 23 11:55:43.822706 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: method: Jun 23 11:55:43.822706 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: exception: Volume tempest-invalid-198921624 could not be found. Jun 23 11:55:43.822706 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: action_args: {'id': 'tempest-invalid-198921624'} Jun 23 11:55:43.822706 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:55:43.823556 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:55:43.823556 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 11:55:43.823556 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 11:55:43.823556 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 23 11:55:43.823556 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 23 11:55:43.823556 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 23 11:55:43.823556 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 23 11:55:43.823556 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 23 11:55:43.823556 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 23 11:55:43.823556 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 23 11:55:43.823556 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 23 11:55:43.823556 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 11:55:43.823556 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 11:55:43.823556 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 11:55:43.823556 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 11:55:43.823556 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-198921624 could not be found. (HTTP 404) (Request-ID: req-7d7331ee-c548-40b0-8c4b-a7e248de9ad6) Jun 23 11:55:43.823556 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:55:43.823556 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:55:43.823556 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:55:43.826180 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:55:43.826180 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 23 11:55:43.826180 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 23 11:55:43.826180 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 11:55:43.826180 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 11:55:43.826180 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 23 11:55:43.826180 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 23 11:55:43.826180 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 11:55:43.826180 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 11:55:43.826180 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 11:55:43.826180 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 11:55:43.826180 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 23 11:55:43.826180 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 23 11:55:43.826180 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 23 11:55:43.826180 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 23 11:55:43.826180 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 23 11:55:43.826180 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 23 11:55:43.826180 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 23 11:55:43.826180 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 23 11:55:43.827533 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 11:55:43.827533 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 11:55:43.827533 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 11:55:43.827533 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 11:55:43.827533 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-198921624 could not be found. Jun 23 11:55:43.827533 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:55:43.827533 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:55:43.827533 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:55:43.827533 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:55:43.827533 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:55:43.827533 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:55:43.827533 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:55:43.827533 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:55:43.827533 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 11:55:43.827533 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 11:55:43.827533 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:55:43.827533 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:55:43.827533 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 23 11:55:43.827533 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:55:43.827533 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-198921624 could not be found. Jun 23 11:55:43.829035 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:55:43.829035 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:55:43.829035 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:55:43.829035 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:55:43.829035 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:55:43.829035 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:55:43.829035 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:55:43.829035 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:55:43.829035 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-198921624 could not be found. Jun 23 11:55:43.829035 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:55:43.829035 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-2a8e7866-583e-47f6-a48d-ad89263b9a17 tempest-VolumesNegativeTest-930873315 tempest-VolumesNegativeTest-930873315-project] Returning 404 to user: Volume tempest-invalid-198921624 could not be found. {{(pid=124669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:55:43.829035 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-2a8e7866-583e-47f6-a48d-ad89263b9a17 tempest-VolumesNegativeTest-930873315 tempest-VolumesNegativeTest-930873315-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/tempest-invalid-198921624" status: 404 len: 98 microversion: 2.1 time: 0.041515 Jun 23 11:55:43.829035 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 562/1130] 10.222.0.13 () {58 vars in 1214 bytes} [Thu Jun 23 11:55:43 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-198921624 => generated 98 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jun 23 11:55:43.835858 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-915b4011-aa12-4949-b290-7142533ee99f tempest-VolumesNegativeTest-930873315 tempest-VolumesNegativeTest-930873315-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003868 Jun 23 11:55:43.836358 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 569/1131] 10.222.0.13 () {58 vars in 1139 bytes} [Thu Jun 23 11:55:43 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 23 11:55:43.846032 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-deb1bcb8-82b4-40cf-85cb-0fe5a52cffa7 tempest-VolumesNegativeTest-930873315 tempest-VolumesNegativeTest-930873315-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003751 Jun 23 11:55:43.846322 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 563/1132] 10.222.0.13 () {58 vars in 1136 bytes} [Thu Jun 23 11:55:43 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 23 11:55:43.854997 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-fc9bad68-999b-4b37-9c35-63e468a79ab8 tempest-VolumesNegativeTest-930873315 tempest-VolumesNegativeTest-930873315-project] Calling method '.version_select at 0x7f5d0af1ac10>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:43.883634 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.wsgi [None req-fc9bad68-999b-4b37-9c35-63e468a79ab8 tempest-VolumesNegativeTest-930873315 tempest-VolumesNegativeTest-930873315-project] HTTP exception thrown: Volume d9bbe499-3fee-42aa-a9e3-efb809a68cda could not be found. Jun 23 11:55:43.885613 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-fc9bad68-999b-4b37-9c35-63e468a79ab8 tempest-VolumesNegativeTest-930873315 tempest-VolumesNegativeTest-930873315-project] Request method failure captured: Jun 23 11:55:43.885613 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: request: DELETE /compute/v2.1/os-volumes/d9bbe499-3fee-42aa-a9e3-efb809a68cda HTTP/1.1 Jun 23 11:55:43.885613 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Accept: application/json Jun 23 11:55:43.885613 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Accept-Encoding: identity Jun 23 11:55:43.885613 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Connection: close Jun 23 11:55:43.885613 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Content-Length: 0 Jun 23 11:55:43.885613 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Content-Type: application/json Jun 23 11:55:43.885613 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Host: 10.222.0.13 Jun 23 11:55:43.885613 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Openstack-System-Scope: None Jun 23 11:55:43.885613 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: User-Agent: python-urllib3/1.26.9 Jun 23 11:55:43.885613 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Auth-Token: gAAAAABitFS_yJTyvknyLuj6CLxvk62WTqsFCK4nZdxQT5spwte0ye4n5o2vmM6cq8RpzXZm1BLIJn_jBbUgQKhZCgP69k4I9R4MpvrUApnQklgV1bdbJxlgNKnuqLdsAcrQonuGJW_-gPKgYr2Xu71QqZhfI2-eURYRlNz7C1-XGt9C8SaBzoQ Jun 23 11:55:43.885613 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Domain-Id: None Jun 23 11:55:43.885613 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Domain-Name: None Jun 23 11:55:43.885613 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Identity-Status: Confirmed Jun 23 11:55:43.885613 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Is-Admin-Project: True Jun 23 11:55:43.885613 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Domain-Id: default Jun 23 11:55:43.885613 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Domain-Name: Default Jun 23 11:55:43.885613 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Id: fd8e176b4c9b4898ae5fc3b201e86e04 Jun 23 11:55:43.885613 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Name: tempest-VolumesNegativeTest-930873315 Jun 23 11:55:43.885613 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Role: member,reader Jun 23 11:55:43.885613 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Roles: member,reader Jun 23 11:55:43.887297 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_fd8e176b4c9b4898ae5fc3b201e86e04"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/fd8e176b4c9b4898ae5fc3b201e86e04"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/fd8e176b4c9b4898ae5fc3b201e86e04"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/fd8e176b4c9b4898ae5fc3b201e86e04"}]}] Jun 23 11:55:43.887297 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Tenant: tempest-VolumesNegativeTest-930873315 Jun 23 11:55:43.887297 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Tenant-Id: fd8e176b4c9b4898ae5fc3b201e86e04 Jun 23 11:55:43.887297 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Tenant-Name: tempest-VolumesNegativeTest-930873315 Jun 23 11:55:43.887297 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User: tempest-VolumesNegativeTest-930873315-project Jun 23 11:55:43.887297 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Domain-Id: default Jun 23 11:55:43.887297 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Domain-Name: Default Jun 23 11:55:43.887297 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Id: 87d269c842ac4f01bfa19335784a7c57 Jun 23 11:55:43.887297 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Name: tempest-VolumesNegativeTest-930873315-project Jun 23 11:55:43.887297 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: method: Jun 23 11:55:43.887297 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: exception: Volume d9bbe499-3fee-42aa-a9e3-efb809a68cda could not be found. Jun 23 11:55:43.887297 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: action_args: {'id': 'd9bbe499-3fee-42aa-a9e3-efb809a68cda'} Jun 23 11:55:43.887297 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:55:43.888432 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:55:43.888432 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 11:55:43.888432 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 11:55:43.888432 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 23 11:55:43.888432 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 23 11:55:43.888432 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 23 11:55:43.888432 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 23 11:55:43.888432 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 23 11:55:43.888432 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 23 11:55:43.888432 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 23 11:55:43.888432 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 23 11:55:43.888432 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 11:55:43.888432 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 11:55:43.888432 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 11:55:43.888432 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 11:55:43.888432 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d9bbe499-3fee-42aa-a9e3-efb809a68cda could not be found. (HTTP 404) (Request-ID: req-268745c7-2b08-4e88-abd3-7e0cbc49f490) Jun 23 11:55:43.888432 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:55:43.888432 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:55:43.888432 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:55:43.889818 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:55:43.889818 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 23 11:55:43.889818 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 23 11:55:43.889818 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 11:55:43.889818 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 11:55:43.889818 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 23 11:55:43.889818 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 23 11:55:43.889818 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 11:55:43.889818 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 11:55:43.889818 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 11:55:43.889818 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 11:55:43.889818 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 23 11:55:43.889818 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 23 11:55:43.889818 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 23 11:55:43.889818 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 23 11:55:43.889818 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 23 11:55:43.889818 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 23 11:55:43.889818 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 23 11:55:43.889818 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 23 11:55:43.891233 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 11:55:43.891233 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 11:55:43.891233 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 11:55:43.891233 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 11:55:43.891233 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d9bbe499-3fee-42aa-a9e3-efb809a68cda could not be found. Jun 23 11:55:43.891233 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:55:43.891233 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:55:43.891233 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:55:43.891233 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:55:43.891233 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:55:43.891233 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:55:43.891233 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:55:43.891233 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:55:43.891233 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 11:55:43.891233 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 11:55:43.891233 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:55:43.891233 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:55:43.891233 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 23 11:55:43.891233 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:55:43.893126 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d9bbe499-3fee-42aa-a9e3-efb809a68cda could not be found. Jun 23 11:55:43.893126 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:55:43.893126 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:55:43.893126 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:55:43.893126 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:55:43.893126 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:55:43.893126 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:55:43.893126 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:55:43.893126 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:55:43.893126 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d9bbe499-3fee-42aa-a9e3-efb809a68cda could not be found. Jun 23 11:55:43.893126 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:55:43.893126 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-fc9bad68-999b-4b37-9c35-63e468a79ab8 tempest-VolumesNegativeTest-930873315 tempest-VolumesNegativeTest-930873315-project] Returning 404 to user: Volume d9bbe499-3fee-42aa-a9e3-efb809a68cda could not be found. {{(pid=124670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:55:43.893126 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-fc9bad68-999b-4b37-9c35-63e468a79ab8 tempest-VolumesNegativeTest-930873315 tempest-VolumesNegativeTest-930873315-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/d9bbe499-3fee-42aa-a9e3-efb809a68cda" status: 404 len: 109 microversion: 2.1 time: 0.035990 Jun 23 11:55:43.893126 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 570/1133] 10.222.0.13 () {58 vars in 1247 bytes} [Thu Jun 23 11:55:43 2022] DELETE /compute/v2.1/os-volumes/d9bbe499-3fee-42aa-a9e3-efb809a68cda => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:55:43.897140 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-7eec51d2-8595-4945-bec2-100621e4f7a5 tempest-VolumesNegativeTest-930873315 tempest-VolumesNegativeTest-930873315-project] Calling method '.version_select at 0x7f5d08b3e0d0>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:43.929466 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.wsgi [None req-7eec51d2-8595-4945-bec2-100621e4f7a5 tempest-VolumesNegativeTest-930873315 tempest-VolumesNegativeTest-930873315-project] HTTP exception thrown: Volume dd7e3c42-7b88-404b-aa69-190975e03379 could not be found. Jun 23 11:55:43.931593 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-7eec51d2-8595-4945-bec2-100621e4f7a5 tempest-VolumesNegativeTest-930873315 tempest-VolumesNegativeTest-930873315-project] Request method failure captured: Jun 23 11:55:43.931593 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: request: GET /compute/v2.1/os-volumes/dd7e3c42-7b88-404b-aa69-190975e03379 HTTP/1.1 Jun 23 11:55:43.931593 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Accept: application/json Jun 23 11:55:43.931593 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Accept-Encoding: identity Jun 23 11:55:43.931593 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Connection: close Jun 23 11:55:43.931593 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Content-Length: 0 Jun 23 11:55:43.931593 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Content-Type: application/json Jun 23 11:55:43.931593 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Host: 10.222.0.13 Jun 23 11:55:43.931593 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Openstack-System-Scope: None Jun 23 11:55:43.931593 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: User-Agent: python-urllib3/1.26.9 Jun 23 11:55:43.931593 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Auth-Token: gAAAAABitFS_yJTyvknyLuj6CLxvk62WTqsFCK4nZdxQT5spwte0ye4n5o2vmM6cq8RpzXZm1BLIJn_jBbUgQKhZCgP69k4I9R4MpvrUApnQklgV1bdbJxlgNKnuqLdsAcrQonuGJW_-gPKgYr2Xu71QqZhfI2-eURYRlNz7C1-XGt9C8SaBzoQ Jun 23 11:55:43.931593 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Domain-Id: None Jun 23 11:55:43.931593 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Domain-Name: None Jun 23 11:55:43.931593 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Identity-Status: Confirmed Jun 23 11:55:43.931593 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Is-Admin-Project: True Jun 23 11:55:43.931593 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Domain-Id: default Jun 23 11:55:43.931593 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Domain-Name: Default Jun 23 11:55:43.931593 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Id: fd8e176b4c9b4898ae5fc3b201e86e04 Jun 23 11:55:43.931593 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Name: tempest-VolumesNegativeTest-930873315 Jun 23 11:55:43.931593 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Role: member,reader Jun 23 11:55:43.931593 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Roles: member,reader Jun 23 11:55:43.932993 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_fd8e176b4c9b4898ae5fc3b201e86e04"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/fd8e176b4c9b4898ae5fc3b201e86e04"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/fd8e176b4c9b4898ae5fc3b201e86e04"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/fd8e176b4c9b4898ae5fc3b201e86e04"}]}] Jun 23 11:55:43.932993 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant: tempest-VolumesNegativeTest-930873315 Jun 23 11:55:43.932993 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant-Id: fd8e176b4c9b4898ae5fc3b201e86e04 Jun 23 11:55:43.932993 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant-Name: tempest-VolumesNegativeTest-930873315 Jun 23 11:55:43.932993 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User: tempest-VolumesNegativeTest-930873315-project Jun 23 11:55:43.932993 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Domain-Id: default Jun 23 11:55:43.932993 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Domain-Name: Default Jun 23 11:55:43.932993 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Id: 87d269c842ac4f01bfa19335784a7c57 Jun 23 11:55:43.932993 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Name: tempest-VolumesNegativeTest-930873315-project Jun 23 11:55:43.932993 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: method: Jun 23 11:55:43.932993 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: exception: Volume dd7e3c42-7b88-404b-aa69-190975e03379 could not be found. Jun 23 11:55:43.932993 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: action_args: {'id': 'dd7e3c42-7b88-404b-aa69-190975e03379'} Jun 23 11:55:43.932993 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:55:43.933836 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:55:43.933836 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 11:55:43.933836 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 11:55:43.933836 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 11:55:43.933836 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 11:55:43.933836 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 11:55:43.933836 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 11:55:43.933836 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 11:55:43.933836 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 11:55:43.933836 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 11:55:43.933836 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 11:55:43.933836 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 11:55:43.933836 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 11:55:43.933836 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 11:55:43.933836 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 11:55:43.933836 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume dd7e3c42-7b88-404b-aa69-190975e03379 could not be found. (HTTP 404) (Request-ID: req-effe2faa-5f93-45e7-b55f-6e4aeb711844) Jun 23 11:55:43.933836 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:55:43.933836 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:55:43.933836 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:55:43.937035 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:55:43.937035 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 23 11:55:43.937035 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 23 11:55:43.937035 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 11:55:43.937035 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 11:55:43.937035 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 23 11:55:43.937035 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 23 11:55:43.937035 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 11:55:43.937035 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 11:55:43.937035 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 11:55:43.937035 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 11:55:43.937035 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 11:55:43.937035 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 11:55:43.937035 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 11:55:43.937035 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 11:55:43.937035 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 11:55:43.937035 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 11:55:43.937035 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 11:55:43.937035 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 11:55:43.938461 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 11:55:43.938461 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 11:55:43.938461 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 11:55:43.938461 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 11:55:43.938461 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume dd7e3c42-7b88-404b-aa69-190975e03379 could not be found. Jun 23 11:55:43.938461 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:55:43.938461 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:55:43.938461 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:55:43.938461 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:55:43.938461 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:55:43.938461 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:55:43.938461 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:55:43.938461 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:55:43.938461 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 11:55:43.938461 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 11:55:43.938461 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:55:43.938461 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:55:43.938461 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 23 11:55:43.938461 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:55:43.940128 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume dd7e3c42-7b88-404b-aa69-190975e03379 could not be found. Jun 23 11:55:43.940128 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:55:43.940128 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:55:43.940128 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:55:43.940128 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:55:43.940128 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:55:43.940128 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:55:43.940128 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:55:43.940128 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:55:43.940128 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume dd7e3c42-7b88-404b-aa69-190975e03379 could not be found. Jun 23 11:55:43.940128 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:55:43.940128 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-7eec51d2-8595-4945-bec2-100621e4f7a5 tempest-VolumesNegativeTest-930873315 tempest-VolumesNegativeTest-930873315-project] Returning 404 to user: Volume dd7e3c42-7b88-404b-aa69-190975e03379 could not be found. {{(pid=124669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:55:43.940128 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-7eec51d2-8595-4945-bec2-100621e4f7a5 tempest-VolumesNegativeTest-930873315 tempest-VolumesNegativeTest-930873315-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/dd7e3c42-7b88-404b-aa69-190975e03379" status: 404 len: 109 microversion: 2.1 time: 0.040063 Jun 23 11:55:43.940128 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 564/1134] 10.222.0.13 () {58 vars in 1244 bytes} [Thu Jun 23 11:55:43 2022] GET /compute/v2.1/os-volumes/dd7e3c42-7b88-404b-aa69-190975e03379 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:56:16.286800 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:16.287558 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:16.291610 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-c8cedbe1-62aa-43f3-800b-a153293bb64d tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:56:16.293336 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-c8cedbe1-62aa-43f3-800b-a153293bb64d tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] [instance: 06c1d69d-fafe-412e-ac84-49c12c6029d0] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:16.299426 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-c8cedbe1-62aa-43f3-800b-a153293bb64d tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:16.299881 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-c8cedbe1-62aa-43f3-800b-a153293bb64d tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:16.300646 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-c8cedbe1-62aa-43f3-800b-a153293bb64d tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:16.301084 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-c8cedbe1-62aa-43f3-800b-a153293bb64d tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:16.527030 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-c8cedbe1-62aa-43f3-800b-a153293bb64d tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] 10.222.0.13 "POST /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0/action" status: 202 len: 0 microversion: 2.1 time: 0.241458 Jun 23 11:56:16.527924 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 571/1135] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Jun 23 11:56:16 2022] POST /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0/action => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 11:56:16.536641 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:16.537456 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_cell1:SELECT=31 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:16.542239 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-1942b1aa-2599-420d-9bb6-2051c56efbc6 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:16.542891 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-1942b1aa-2599-420d-9bb6-2051c56efbc6 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] [instance: 06c1d69d-fafe-412e-ac84-49c12c6029d0] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:16.550117 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-1942b1aa-2599-420d-9bb6-2051c56efbc6 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:16.555369 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-1942b1aa-2599-420d-9bb6-2051c56efbc6 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:16.555369 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-1942b1aa-2599-420d-9bb6-2051c56efbc6 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:16.555369 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-1942b1aa-2599-420d-9bb6-2051c56efbc6 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:16.700411 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-1942b1aa-2599-420d-9bb6-2051c56efbc6 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a4c8e15cd44904805c2519c4b6864a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a1542e108d4e3e85fe5525a7e331d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:16.708657 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-1942b1aa-2599-420d-9bb6-2051c56efbc6 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] 10.222.0.13 "GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0" status: 200 len: 1751 microversion: 2.1 time: 0.175463 Jun 23 11:56:16.709307 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 565/1136] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:16 2022] GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0 => generated 1751 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:17.728217 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-7fa705f1-9a2a-4aed-bf77-0dc5f660f17a tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:17.728997 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-7fa705f1-9a2a-4aed-bf77-0dc5f660f17a tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] [instance: 06c1d69d-fafe-412e-ac84-49c12c6029d0] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:17.735803 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-7fa705f1-9a2a-4aed-bf77-0dc5f660f17a tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:17.736250 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-7fa705f1-9a2a-4aed-bf77-0dc5f660f17a tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:17.737007 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-7fa705f1-9a2a-4aed-bf77-0dc5f660f17a tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:17.737441 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-7fa705f1-9a2a-4aed-bf77-0dc5f660f17a tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:17.882997 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-7fa705f1-9a2a-4aed-bf77-0dc5f660f17a tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a4c8e15cd44904805c2519c4b6864a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a1542e108d4e3e85fe5525a7e331d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:17.891305 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-7fa705f1-9a2a-4aed-bf77-0dc5f660f17a tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] 10.222.0.13 "GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0" status: 200 len: 1756 microversion: 2.1 time: 0.168194 Jun 23 11:56:17.892847 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 572/1137] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:17 2022] GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0 => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:18.909152 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-4b1c5059-222f-4691-824f-5695492edd18 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:18.909762 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-4b1c5059-222f-4691-824f-5695492edd18 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] [instance: 06c1d69d-fafe-412e-ac84-49c12c6029d0] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:18.917791 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-4b1c5059-222f-4691-824f-5695492edd18 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:18.918565 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-4b1c5059-222f-4691-824f-5695492edd18 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:18.919685 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-4b1c5059-222f-4691-824f-5695492edd18 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:18.920097 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-4b1c5059-222f-4691-824f-5695492edd18 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:19.080902 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-4b1c5059-222f-4691-824f-5695492edd18 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a4c8e15cd44904805c2519c4b6864a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a1542e108d4e3e85fe5525a7e331d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:19.084326 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-4b1c5059-222f-4691-824f-5695492edd18 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] 10.222.0.13 "GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0" status: 200 len: 1756 microversion: 2.1 time: 0.178861 Jun 23 11:56:19.084886 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 566/1138] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:18 2022] GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0 => generated 1756 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:56:20.101701 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-da68b5fb-7276-40c4-be9b-cbacc7717adb tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:20.102439 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-da68b5fb-7276-40c4-be9b-cbacc7717adb tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] [instance: 06c1d69d-fafe-412e-ac84-49c12c6029d0] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:20.109225 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-da68b5fb-7276-40c4-be9b-cbacc7717adb tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:20.109672 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-da68b5fb-7276-40c4-be9b-cbacc7717adb tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:20.110432 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-da68b5fb-7276-40c4-be9b-cbacc7717adb tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:20.110890 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-da68b5fb-7276-40c4-be9b-cbacc7717adb tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:20.261811 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-da68b5fb-7276-40c4-be9b-cbacc7717adb tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a4c8e15cd44904805c2519c4b6864a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a1542e108d4e3e85fe5525a7e331d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:20.270858 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-da68b5fb-7276-40c4-be9b-cbacc7717adb tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] 10.222.0.13 "GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0" status: 200 len: 1756 microversion: 2.1 time: 0.173055 Jun 23 11:56:20.271431 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 573/1139] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:20 2022] GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0 => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:20.635761 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-10740ead-012a-49d2-8d82-66cb4a2ccd57 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:20.636254 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-10740ead-012a-49d2-8d82-66cb4a2ccd57 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] [instance: 6eefd0c5-c18b-435a-ac13-1a69019d4699] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:20.639603 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [req-354530dd-326d-4e2a-b434-d38e52f7a2cb req-a088ce12-b33f-4945-a71a-43513c19d756 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6eefd0c5-c18b-435a-ac13-1a69019d4699", "tag": "2de3e3ea-22ec-4a86-899e-8c17d01954c3"}]} {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:56:20.643113 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-10740ead-012a-49d2-8d82-66cb4a2ccd57 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:20.643766 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-10740ead-012a-49d2-8d82-66cb4a2ccd57 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:20.644713 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-10740ead-012a-49d2-8d82-66cb4a2ccd57 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:20.645311 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-10740ead-012a-49d2-8d82-66cb4a2ccd57 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:20.648305 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-354530dd-326d-4e2a-b434-d38e52f7a2cb req-a088ce12-b33f-4945-a71a-43513c19d756 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:20.648754 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-354530dd-326d-4e2a-b434-d38e52f7a2cb req-a088ce12-b33f-4945-a71a-43513c19d756 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:20.661857 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.compute.server_external_events [req-354530dd-326d-4e2a-b434-d38e52f7a2cb req-a088ce12-b33f-4945-a71a-43513c19d756 service nova] Creating event network-changed:2de3e3ea-22ec-4a86-899e-8c17d01954c3 for instance 6eefd0c5-c18b-435a-ac13-1a69019d4699 on hv-cinder-82099 Jun 23 11:56:20.668037 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [req-354530dd-326d-4e2a-b434-d38e52f7a2cb req-a088ce12-b33f-4945-a71a-43513c19d756 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032591 Jun 23 11:56:20.668635 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 574/1140] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:56:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:56:20.679928 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-10740ead-012a-49d2-8d82-66cb4a2ccd57 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] [instance: 6eefd0c5-c18b-435a-ac13-1a69019d4699] Going to try to terminate instance {{(pid=124669) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 11:56:20.957401 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-10740ead-012a-49d2-8d82-66cb4a2ccd57 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] 10.222.0.13 "DELETE /compute/v2.1/servers/6eefd0c5-c18b-435a-ac13-1a69019d4699" status: 204 len: 0 microversion: 2.1 time: 0.325019 Jun 23 11:56:20.957992 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 567/1141] 10.222.0.13 () {58 vars in 1238 bytes} [Thu Jun 23 11:56:20 2022] DELETE /compute/v2.1/servers/6eefd0c5-c18b-435a-ac13-1a69019d4699 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 11:56:20.967550 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-67653026-ceda-45da-9d64-053b58ecf4ae tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:20.968513 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-67653026-ceda-45da-9d64-053b58ecf4ae tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] [instance: 6eefd0c5-c18b-435a-ac13-1a69019d4699] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:20.975176 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-67653026-ceda-45da-9d64-053b58ecf4ae tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:20.975640 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-67653026-ceda-45da-9d64-053b58ecf4ae tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:20.980392 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-67653026-ceda-45da-9d64-053b58ecf4ae tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:20.980392 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-67653026-ceda-45da-9d64-053b58ecf4ae tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:21.113565 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-67653026-ceda-45da-9d64-053b58ecf4ae tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc5a4676f6a416cbdc8c67ebd80cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e810a9bc3b44c4aa8ca2ddd0fa68f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:21.121094 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-67653026-ceda-45da-9d64-053b58ecf4ae tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] 10.222.0.13 "GET /compute/v2.1/servers/6eefd0c5-c18b-435a-ac13-1a69019d4699" status: 200 len: 1576 microversion: 2.1 time: 0.158467 Jun 23 11:56:21.121654 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 575/1142] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:20 2022] GET /compute/v2.1/servers/6eefd0c5-c18b-435a-ac13-1a69019d4699 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:21.295524 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-eb01c0e7-eebf-4848-8473-858de5ead4d2 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:21.296236 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-eb01c0e7-eebf-4848-8473-858de5ead4d2 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] [instance: 06c1d69d-fafe-412e-ac84-49c12c6029d0] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:21.302485 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-eb01c0e7-eebf-4848-8473-858de5ead4d2 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:21.305431 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-eb01c0e7-eebf-4848-8473-858de5ead4d2 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:21.305431 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-eb01c0e7-eebf-4848-8473-858de5ead4d2 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:21.305431 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-eb01c0e7-eebf-4848-8473-858de5ead4d2 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:21.453093 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-eb01c0e7-eebf-4848-8473-858de5ead4d2 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a4c8e15cd44904805c2519c4b6864a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a1542e108d4e3e85fe5525a7e331d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:21.461275 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-eb01c0e7-eebf-4848-8473-858de5ead4d2 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] 10.222.0.13 "GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0" status: 200 len: 1756 microversion: 2.1 time: 0.170598 Jun 23 11:56:21.461850 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 568/1143] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:21 2022] GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0 => generated 1756 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:22.141197 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-75251309-82ec-47d2-ba97-8282a19c843a tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:22.141810 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-75251309-82ec-47d2-ba97-8282a19c843a tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] [instance: 6eefd0c5-c18b-435a-ac13-1a69019d4699] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:22.148350 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-75251309-82ec-47d2-ba97-8282a19c843a tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:22.148862 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-75251309-82ec-47d2-ba97-8282a19c843a tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:22.149572 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-75251309-82ec-47d2-ba97-8282a19c843a tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:22.150007 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-75251309-82ec-47d2-ba97-8282a19c843a tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:22.286017 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-75251309-82ec-47d2-ba97-8282a19c843a tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc5a4676f6a416cbdc8c67ebd80cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e810a9bc3b44c4aa8ca2ddd0fa68f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:22.293503 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-75251309-82ec-47d2-ba97-8282a19c843a tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] 10.222.0.13 "GET /compute/v2.1/servers/6eefd0c5-c18b-435a-ac13-1a69019d4699" status: 200 len: 1576 microversion: 2.1 time: 0.157148 Jun 23 11:56:22.294190 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 576/1144] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:22 2022] GET /compute/v2.1/servers/6eefd0c5-c18b-435a-ac13-1a69019d4699 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:22.478962 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-8598038e-c75a-47c7-ac5f-d1e94b4bfc2c tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:22.479538 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-8598038e-c75a-47c7-ac5f-d1e94b4bfc2c tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] [instance: 06c1d69d-fafe-412e-ac84-49c12c6029d0] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:22.486721 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-8598038e-c75a-47c7-ac5f-d1e94b4bfc2c tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:22.487172 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-8598038e-c75a-47c7-ac5f-d1e94b4bfc2c tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:22.487933 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-8598038e-c75a-47c7-ac5f-d1e94b4bfc2c tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:22.488366 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-8598038e-c75a-47c7-ac5f-d1e94b4bfc2c tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:22.632954 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-8598038e-c75a-47c7-ac5f-d1e94b4bfc2c tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a4c8e15cd44904805c2519c4b6864a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a1542e108d4e3e85fe5525a7e331d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:22.640969 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-8598038e-c75a-47c7-ac5f-d1e94b4bfc2c tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] 10.222.0.13 "GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0" status: 200 len: 1756 microversion: 2.1 time: 0.165916 Jun 23 11:56:22.641554 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 569/1145] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:22 2022] GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:23.310635 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-727658dd-963c-4ed1-959f-8b115e3f288d tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:23.311269 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-727658dd-963c-4ed1-959f-8b115e3f288d tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] [instance: 6eefd0c5-c18b-435a-ac13-1a69019d4699] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:23.317391 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-727658dd-963c-4ed1-959f-8b115e3f288d tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:23.317837 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-727658dd-963c-4ed1-959f-8b115e3f288d tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:23.318617 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-727658dd-963c-4ed1-959f-8b115e3f288d tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:23.319051 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-727658dd-963c-4ed1-959f-8b115e3f288d tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:23.446875 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-727658dd-963c-4ed1-959f-8b115e3f288d tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc5a4676f6a416cbdc8c67ebd80cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e810a9bc3b44c4aa8ca2ddd0fa68f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:23.455404 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-727658dd-963c-4ed1-959f-8b115e3f288d tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] 10.222.0.13 "GET /compute/v2.1/servers/6eefd0c5-c18b-435a-ac13-1a69019d4699" status: 200 len: 1576 microversion: 2.1 time: 0.148592 Jun 23 11:56:23.455883 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 577/1146] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:23 2022] GET /compute/v2.1/servers/6eefd0c5-c18b-435a-ac13-1a69019d4699 => generated 1576 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:23.658089 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-7ea8e8b3-a9cd-425b-ac9f-f3f1a79492e8 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:23.658732 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-7ea8e8b3-a9cd-425b-ac9f-f3f1a79492e8 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] [instance: 06c1d69d-fafe-412e-ac84-49c12c6029d0] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:23.665145 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-7ea8e8b3-a9cd-425b-ac9f-f3f1a79492e8 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:23.665591 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-7ea8e8b3-a9cd-425b-ac9f-f3f1a79492e8 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:23.666336 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-7ea8e8b3-a9cd-425b-ac9f-f3f1a79492e8 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:23.666808 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-7ea8e8b3-a9cd-425b-ac9f-f3f1a79492e8 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:23.818225 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-7ea8e8b3-a9cd-425b-ac9f-f3f1a79492e8 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a4c8e15cd44904805c2519c4b6864a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a1542e108d4e3e85fe5525a7e331d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:23.826791 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-7ea8e8b3-a9cd-425b-ac9f-f3f1a79492e8 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] 10.222.0.13 "GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0" status: 200 len: 1756 microversion: 2.1 time: 0.173522 Jun 23 11:56:23.827352 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 570/1147] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:23 2022] GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0 => generated 1756 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:24.472614 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-39739978-eb19-4ef9-b3a5-9641a8c77b23 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:24.473707 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-39739978-eb19-4ef9-b3a5-9641a8c77b23 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] [instance: 6eefd0c5-c18b-435a-ac13-1a69019d4699] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:24.480547 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-39739978-eb19-4ef9-b3a5-9641a8c77b23 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:24.480940 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-39739978-eb19-4ef9-b3a5-9641a8c77b23 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:24.482326 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-39739978-eb19-4ef9-b3a5-9641a8c77b23 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:24.482791 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-39739978-eb19-4ef9-b3a5-9641a8c77b23 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:24.612439 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-39739978-eb19-4ef9-b3a5-9641a8c77b23 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc5a4676f6a416cbdc8c67ebd80cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e810a9bc3b44c4aa8ca2ddd0fa68f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:24.619959 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-39739978-eb19-4ef9-b3a5-9641a8c77b23 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] 10.222.0.13 "GET /compute/v2.1/servers/6eefd0c5-c18b-435a-ac13-1a69019d4699" status: 200 len: 1576 microversion: 2.1 time: 0.151157 Jun 23 11:56:24.620523 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 578/1148] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:24 2022] GET /compute/v2.1/servers/6eefd0c5-c18b-435a-ac13-1a69019d4699 => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:24.844351 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-f2e388cc-d8d4-444c-a01f-639b846f643d tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:24.844964 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-f2e388cc-d8d4-444c-a01f-639b846f643d tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] [instance: 06c1d69d-fafe-412e-ac84-49c12c6029d0] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:24.851407 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-f2e388cc-d8d4-444c-a01f-639b846f643d tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:24.851856 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-f2e388cc-d8d4-444c-a01f-639b846f643d tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:24.852603 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-f2e388cc-d8d4-444c-a01f-639b846f643d tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:24.853034 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-f2e388cc-d8d4-444c-a01f-639b846f643d tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:24.993194 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-f2e388cc-d8d4-444c-a01f-639b846f643d tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a4c8e15cd44904805c2519c4b6864a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a1542e108d4e3e85fe5525a7e331d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:25.001537 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-f2e388cc-d8d4-444c-a01f-639b846f643d tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] 10.222.0.13 "GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0" status: 200 len: 1756 microversion: 2.1 time: 0.162117 Jun 23 11:56:25.002100 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 571/1149] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:24 2022] GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0 => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:25.637268 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-e7689e9b-55d9-4cd9-8e67-7f96fe5fd4c6 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:25.637983 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-e7689e9b-55d9-4cd9-8e67-7f96fe5fd4c6 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] [instance: 6eefd0c5-c18b-435a-ac13-1a69019d4699] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:25.644484 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-e7689e9b-55d9-4cd9-8e67-7f96fe5fd4c6 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:25.644931 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-e7689e9b-55d9-4cd9-8e67-7f96fe5fd4c6 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:25.645693 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-e7689e9b-55d9-4cd9-8e67-7f96fe5fd4c6 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:25.646128 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-e7689e9b-55d9-4cd9-8e67-7f96fe5fd4c6 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:25.776972 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-e7689e9b-55d9-4cd9-8e67-7f96fe5fd4c6 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc5a4676f6a416cbdc8c67ebd80cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e810a9bc3b44c4aa8ca2ddd0fa68f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:25.784585 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-e7689e9b-55d9-4cd9-8e67-7f96fe5fd4c6 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] 10.222.0.13 "GET /compute/v2.1/servers/6eefd0c5-c18b-435a-ac13-1a69019d4699" status: 200 len: 1576 microversion: 2.1 time: 0.151213 Jun 23 11:56:25.785146 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 579/1150] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:25 2022] GET /compute/v2.1/servers/6eefd0c5-c18b-435a-ac13-1a69019d4699 => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:26.018489 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-def31808-75eb-446c-b4c0-43fb418cb456 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:26.019066 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-def31808-75eb-446c-b4c0-43fb418cb456 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] [instance: 06c1d69d-fafe-412e-ac84-49c12c6029d0] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:26.025472 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-def31808-75eb-446c-b4c0-43fb418cb456 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:26.025917 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-def31808-75eb-446c-b4c0-43fb418cb456 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:26.026709 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-def31808-75eb-446c-b4c0-43fb418cb456 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:26.027145 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-def31808-75eb-446c-b4c0-43fb418cb456 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:26.168443 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-def31808-75eb-446c-b4c0-43fb418cb456 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a4c8e15cd44904805c2519c4b6864a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a1542e108d4e3e85fe5525a7e331d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:26.177227 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-def31808-75eb-446c-b4c0-43fb418cb456 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] 10.222.0.13 "GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0" status: 200 len: 1756 microversion: 2.1 time: 0.162637 Jun 23 11:56:26.177796 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 572/1151] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:26 2022] GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:26.801645 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-2d253f35-a81b-4d68-85b9-d25ea837a6fc tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:26.802252 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-2d253f35-a81b-4d68-85b9-d25ea837a6fc tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] [instance: 6eefd0c5-c18b-435a-ac13-1a69019d4699] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:26.808763 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-2d253f35-a81b-4d68-85b9-d25ea837a6fc tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:26.809204 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-2d253f35-a81b-4d68-85b9-d25ea837a6fc tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:26.810521 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-2d253f35-a81b-4d68-85b9-d25ea837a6fc tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:26.810969 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-2d253f35-a81b-4d68-85b9-d25ea837a6fc tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:26.945046 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-2d253f35-a81b-4d68-85b9-d25ea837a6fc tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc5a4676f6a416cbdc8c67ebd80cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e810a9bc3b44c4aa8ca2ddd0fa68f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:26.953168 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-2d253f35-a81b-4d68-85b9-d25ea837a6fc tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] 10.222.0.13 "GET /compute/v2.1/servers/6eefd0c5-c18b-435a-ac13-1a69019d4699" status: 200 len: 1576 microversion: 2.1 time: 0.155443 Jun 23 11:56:26.953726 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 580/1152] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:26 2022] GET /compute/v2.1/servers/6eefd0c5-c18b-435a-ac13-1a69019d4699 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:27.194273 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-0cbd0ecf-939d-4c05-95ec-bf6c7546d540 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:27.194912 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-0cbd0ecf-939d-4c05-95ec-bf6c7546d540 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] [instance: 06c1d69d-fafe-412e-ac84-49c12c6029d0] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:27.201976 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-0cbd0ecf-939d-4c05-95ec-bf6c7546d540 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:27.202610 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-0cbd0ecf-939d-4c05-95ec-bf6c7546d540 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:27.203485 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-0cbd0ecf-939d-4c05-95ec-bf6c7546d540 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:27.203923 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-0cbd0ecf-939d-4c05-95ec-bf6c7546d540 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:27.343739 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-0cbd0ecf-939d-4c05-95ec-bf6c7546d540 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a4c8e15cd44904805c2519c4b6864a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a1542e108d4e3e85fe5525a7e331d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:27.351587 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-0cbd0ecf-939d-4c05-95ec-bf6c7546d540 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] 10.222.0.13 "GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0" status: 200 len: 1756 microversion: 2.1 time: 0.161180 Jun 23 11:56:27.352147 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 573/1153] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:27 2022] GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0 => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:27.971934 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-b2c7b9a6-5047-4433-9c7b-f59c377abd68 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:27.972546 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-b2c7b9a6-5047-4433-9c7b-f59c377abd68 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] [instance: 6eefd0c5-c18b-435a-ac13-1a69019d4699] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:27.979178 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-b2c7b9a6-5047-4433-9c7b-f59c377abd68 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:27.979636 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-b2c7b9a6-5047-4433-9c7b-f59c377abd68 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:27.980688 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-b2c7b9a6-5047-4433-9c7b-f59c377abd68 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:27.981120 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-b2c7b9a6-5047-4433-9c7b-f59c377abd68 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:28.189110 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-b2c7b9a6-5047-4433-9c7b-f59c377abd68 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc5a4676f6a416cbdc8c67ebd80cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e810a9bc3b44c4aa8ca2ddd0fa68f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:28.197190 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-b2c7b9a6-5047-4433-9c7b-f59c377abd68 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] 10.222.0.13 "GET /compute/v2.1/servers/6eefd0c5-c18b-435a-ac13-1a69019d4699" status: 200 len: 1576 microversion: 2.1 time: 0.229522 Jun 23 11:56:28.197762 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 581/1154] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:27 2022] GET /compute/v2.1/servers/6eefd0c5-c18b-435a-ac13-1a69019d4699 => generated 1576 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:28.370196 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-7217b932-8e2b-488d-96f0-449d801d74d5 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:28.370832 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-7217b932-8e2b-488d-96f0-449d801d74d5 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] [instance: 06c1d69d-fafe-412e-ac84-49c12c6029d0] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:28.378236 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-7217b932-8e2b-488d-96f0-449d801d74d5 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:28.378798 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-7217b932-8e2b-488d-96f0-449d801d74d5 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:28.379633 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-7217b932-8e2b-488d-96f0-449d801d74d5 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:28.380066 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-7217b932-8e2b-488d-96f0-449d801d74d5 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:28.540777 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-7217b932-8e2b-488d-96f0-449d801d74d5 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a4c8e15cd44904805c2519c4b6864a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a1542e108d4e3e85fe5525a7e331d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:28.549850 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-7217b932-8e2b-488d-96f0-449d801d74d5 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] 10.222.0.13 "GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0" status: 200 len: 1756 microversion: 2.1 time: 0.184523 Jun 23 11:56:28.550672 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 574/1155] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:28 2022] GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0 => generated 1756 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:28.564256 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [req-f4fff4d8-c90a-4f40-8c78-2a16fb063cdc req-f20931a5-56bf-4f54-827e-0b22a8655658 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6eefd0c5-c18b-435a-ac13-1a69019d4699", "name": "network-vif-deleted", "tag": "2de3e3ea-22ec-4a86-899e-8c17d01954c3"}]} {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:56:28.572673 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-f4fff4d8-c90a-4f40-8c78-2a16fb063cdc req-f20931a5-56bf-4f54-827e-0b22a8655658 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:28.573116 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-f4fff4d8-c90a-4f40-8c78-2a16fb063cdc req-f20931a5-56bf-4f54-827e-0b22a8655658 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:28.584878 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.compute.server_external_events [req-f4fff4d8-c90a-4f40-8c78-2a16fb063cdc req-f20931a5-56bf-4f54-827e-0b22a8655658 service nova] Creating event network-vif-deleted:2de3e3ea-22ec-4a86-899e-8c17d01954c3 for instance 6eefd0c5-c18b-435a-ac13-1a69019d4699 on hv-cinder-82099 Jun 23 11:56:28.590034 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [req-f4fff4d8-c90a-4f40-8c78-2a16fb063cdc req-f20931a5-56bf-4f54-827e-0b22a8655658 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.181381 Jun 23 11:56:28.591593 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 582/1156] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:56:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:56:29.214907 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-0ef37e08-ec81-471d-b438-2da97515f30e tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:29.215438 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-0ef37e08-ec81-471d-b438-2da97515f30e tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] [instance: 6eefd0c5-c18b-435a-ac13-1a69019d4699] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:29.221550 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-0ef37e08-ec81-471d-b438-2da97515f30e tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:29.221998 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-0ef37e08-ec81-471d-b438-2da97515f30e tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:29.222778 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-0ef37e08-ec81-471d-b438-2da97515f30e tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:29.223215 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-0ef37e08-ec81-471d-b438-2da97515f30e tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:29.253532 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-0ef37e08-ec81-471d-b438-2da97515f30e tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:29.253980 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-0ef37e08-ec81-471d-b438-2da97515f30e tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:29.254422 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.objects.instance [None req-0ef37e08-ec81-471d-b438-2da97515f30e tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lazy-loading 'fault' on Instance uuid 6eefd0c5-c18b-435a-ac13-1a69019d4699 {{(pid=124669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:56:29.295569 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-0ef37e08-ec81-471d-b438-2da97515f30e tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc5a4676f6a416cbdc8c67ebd80cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e810a9bc3b44c4aa8ca2ddd0fa68f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:29.303127 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-0ef37e08-ec81-471d-b438-2da97515f30e tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] 10.222.0.13 "GET /compute/v2.1/servers/6eefd0c5-c18b-435a-ac13-1a69019d4699" status: 200 len: 1229 microversion: 2.1 time: 0.092197 Jun 23 11:56:29.303689 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 575/1157] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:29 2022] GET /compute/v2.1/servers/6eefd0c5-c18b-435a-ac13-1a69019d4699 => generated 1229 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:29.568094 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-9ba9ef1f-0a17-4b14-a9a1-0c3aa7c41f5e tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:29.568894 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-9ba9ef1f-0a17-4b14-a9a1-0c3aa7c41f5e tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] [instance: 06c1d69d-fafe-412e-ac84-49c12c6029d0] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:29.576118 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-9ba9ef1f-0a17-4b14-a9a1-0c3aa7c41f5e tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:29.576575 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-9ba9ef1f-0a17-4b14-a9a1-0c3aa7c41f5e tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:29.577398 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-9ba9ef1f-0a17-4b14-a9a1-0c3aa7c41f5e tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:29.577837 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-9ba9ef1f-0a17-4b14-a9a1-0c3aa7c41f5e tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:29.735195 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-9ba9ef1f-0a17-4b14-a9a1-0c3aa7c41f5e tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a4c8e15cd44904805c2519c4b6864a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a1542e108d4e3e85fe5525a7e331d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:29.745575 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-9ba9ef1f-0a17-4b14-a9a1-0c3aa7c41f5e tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] 10.222.0.13 "GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0" status: 200 len: 1756 microversion: 2.1 time: 0.179781 Jun 23 11:56:29.745575 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 583/1158] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:29 2022] GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0 => generated 1756 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:30.321313 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-050150f1-e628-4c5e-972d-62dd170e7c79 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:30.321922 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-050150f1-e628-4c5e-972d-62dd170e7c79 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] [instance: 6eefd0c5-c18b-435a-ac13-1a69019d4699] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:30.329509 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-050150f1-e628-4c5e-972d-62dd170e7c79 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:30.329954 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-050150f1-e628-4c5e-972d-62dd170e7c79 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:30.330738 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-050150f1-e628-4c5e-972d-62dd170e7c79 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:30.331175 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-050150f1-e628-4c5e-972d-62dd170e7c79 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:30.362433 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-050150f1-e628-4c5e-972d-62dd170e7c79 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:30.362928 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-050150f1-e628-4c5e-972d-62dd170e7c79 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:30.363368 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.objects.instance [None req-050150f1-e628-4c5e-972d-62dd170e7c79 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lazy-loading 'fault' on Instance uuid 6eefd0c5-c18b-435a-ac13-1a69019d4699 {{(pid=124669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:56:30.407375 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-050150f1-e628-4c5e-972d-62dd170e7c79 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc5a4676f6a416cbdc8c67ebd80cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e810a9bc3b44c4aa8ca2ddd0fa68f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:30.414801 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-050150f1-e628-4c5e-972d-62dd170e7c79 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] 10.222.0.13 "GET /compute/v2.1/servers/6eefd0c5-c18b-435a-ac13-1a69019d4699" status: 200 len: 1229 microversion: 2.1 time: 0.097390 Jun 23 11:56:30.415366 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 576/1159] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:30 2022] GET /compute/v2.1/servers/6eefd0c5-c18b-435a-ac13-1a69019d4699 => generated 1229 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:30.761459 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-88074706-d435-4465-aae7-6f42d0fb72c1 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:30.761967 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-88074706-d435-4465-aae7-6f42d0fb72c1 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] [instance: 06c1d69d-fafe-412e-ac84-49c12c6029d0] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:30.769247 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-88074706-d435-4465-aae7-6f42d0fb72c1 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:30.769690 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-88074706-d435-4465-aae7-6f42d0fb72c1 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:30.770434 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-88074706-d435-4465-aae7-6f42d0fb72c1 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:30.770891 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-88074706-d435-4465-aae7-6f42d0fb72c1 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:30.912372 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-88074706-d435-4465-aae7-6f42d0fb72c1 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a4c8e15cd44904805c2519c4b6864a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a1542e108d4e3e85fe5525a7e331d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:30.922106 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-88074706-d435-4465-aae7-6f42d0fb72c1 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] 10.222.0.13 "GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0" status: 200 len: 1756 microversion: 2.1 time: 0.164551 Jun 23 11:56:30.922701 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 584/1160] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:30 2022] GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:56:31.432081 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-83d24d95-cb82-4873-8ea8-e01d72788cf7 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:31.432723 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-83d24d95-cb82-4873-8ea8-e01d72788cf7 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] [instance: 6eefd0c5-c18b-435a-ac13-1a69019d4699] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:31.439795 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-83d24d95-cb82-4873-8ea8-e01d72788cf7 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:31.440244 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-83d24d95-cb82-4873-8ea8-e01d72788cf7 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:31.440998 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-83d24d95-cb82-4873-8ea8-e01d72788cf7 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:31.441436 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-83d24d95-cb82-4873-8ea8-e01d72788cf7 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:31.455170 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.wsgi [None req-83d24d95-cb82-4873-8ea8-e01d72788cf7 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] HTTP exception thrown: Instance 6eefd0c5-c18b-435a-ac13-1a69019d4699 could not be found. Jun 23 11:56:31.456785 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-83d24d95-cb82-4873-8ea8-e01d72788cf7 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Request method failure captured: Jun 23 11:56:31.456785 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: request: GET /compute/v2.1/servers/6eefd0c5-c18b-435a-ac13-1a69019d4699 HTTP/1.1 Jun 23 11:56:31.456785 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Accept: application/json Jun 23 11:56:31.456785 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Accept-Encoding: identity Jun 23 11:56:31.456785 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Connection: close Jun 23 11:56:31.456785 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Content-Length: 0 Jun 23 11:56:31.456785 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Content-Type: application/json Jun 23 11:56:31.456785 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Host: 10.222.0.13 Jun 23 11:56:31.456785 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Openstack-System-Scope: None Jun 23 11:56:31.456785 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: User-Agent: python-urllib3/1.26.9 Jun 23 11:56:31.456785 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Auth-Token: gAAAAABitFKrXJlGv4Y10nZpBqokawq1fsvWINJ6On9pjTbZcDoDz6HvHtwtJWthsDNegb9YIJput0wiweHEs02NPCmIjRC79du2T88hCpYxuEgvtooi0sBEM-VyipUNCAzHQ0gWdAGR_dUjDy3okf2_2yYQDZguvq9NDjINnrdjdvaf9KiLdeA Jun 23 11:56:31.456785 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Domain-Id: None Jun 23 11:56:31.456785 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Domain-Name: None Jun 23 11:56:31.456785 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Identity-Status: Confirmed Jun 23 11:56:31.456785 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Is-Admin-Project: True Jun 23 11:56:31.456785 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Domain-Id: default Jun 23 11:56:31.456785 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Domain-Name: Default Jun 23 11:56:31.456785 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Id: 2e810a9bc3b44c4aa8ca2ddd0fa68f7b Jun 23 11:56:31.456785 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Name: tempest-TestVolumeBootPattern-220427877 Jun 23 11:56:31.456785 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Role: member,reader Jun 23 11:56:31.456785 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Roles: member,reader Jun 23 11:56:31.458569 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2e810a9bc3b44c4aa8ca2ddd0fa68f7b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2e810a9bc3b44c4aa8ca2ddd0fa68f7b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2e810a9bc3b44c4aa8ca2ddd0fa68f7b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2e810a9bc3b44c4aa8ca2ddd0fa68f7b"}]}] Jun 23 11:56:31.458569 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant: tempest-TestVolumeBootPattern-220427877 Jun 23 11:56:31.458569 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant-Id: 2e810a9bc3b44c4aa8ca2ddd0fa68f7b Jun 23 11:56:31.458569 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant-Name: tempest-TestVolumeBootPattern-220427877 Jun 23 11:56:31.458569 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User: tempest-TestVolumeBootPattern-220427877-project Jun 23 11:56:31.458569 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Domain-Id: default Jun 23 11:56:31.458569 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Domain-Name: Default Jun 23 11:56:31.458569 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Id: 6cc5a4676f6a416cbdc8c67ebd80cdf3 Jun 23 11:56:31.458569 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Name: tempest-TestVolumeBootPattern-220427877-project Jun 23 11:56:31.458569 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: method: > Jun 23 11:56:31.458569 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: exception: Instance 6eefd0c5-c18b-435a-ac13-1a69019d4699 could not be found. Jun 23 11:56:31.458569 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: action_args: {'id': '6eefd0c5-c18b-435a-ac13-1a69019d4699'} Jun 23 11:56:31.459514 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:56:31.459514 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:56:31.459514 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:56:31.459514 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:56:31.459514 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:56:31.459514 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:56:31.459514 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:56:31.459514 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:56:31.459514 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:56:31.459514 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:56:31.459514 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6eefd0c5-c18b-435a-ac13-1a69019d4699 could not be found. Jun 23 11:56:31.459514 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:56:31.459514 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:56:31.459514 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:56:31.459514 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:56:31.459514 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:56:31.459514 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:56:31.459514 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:56:31.459514 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:56:31.459514 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:56:31.461112 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:56:31.461112 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 11:56:31.461112 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 11:56:31.461112 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:56:31.461112 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:56:31.461112 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:56:31.461112 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:56:31.461112 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6eefd0c5-c18b-435a-ac13-1a69019d4699 could not be found. Jun 23 11:56:31.461112 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:56:31.461112 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:56:31.461112 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:56:31.461112 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:56:31.461112 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:56:31.461112 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:56:31.461112 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:56:31.461112 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:56:31.461112 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6eefd0c5-c18b-435a-ac13-1a69019d4699 could not be found. Jun 23 11:56:31.461112 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:56:31.462583 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-83d24d95-cb82-4873-8ea8-e01d72788cf7 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Returning 404 to user: Instance 6eefd0c5-c18b-435a-ac13-1a69019d4699 could not be found. {{(pid=124669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:56:31.462583 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-83d24d95-cb82-4873-8ea8-e01d72788cf7 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] 10.222.0.13 "GET /compute/v2.1/servers/6eefd0c5-c18b-435a-ac13-1a69019d4699" status: 404 len: 111 microversion: 2.1 time: 0.029997 Jun 23 11:56:31.462583 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 577/1161] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:31 2022] GET /compute/v2.1/servers/6eefd0c5-c18b-435a-ac13-1a69019d4699 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:56:31.939482 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-d7a8c5eb-90ed-4e5a-9dff-fc9d9a98318a tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:31.940050 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-d7a8c5eb-90ed-4e5a-9dff-fc9d9a98318a tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] [instance: 06c1d69d-fafe-412e-ac84-49c12c6029d0] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:31.946431 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-d7a8c5eb-90ed-4e5a-9dff-fc9d9a98318a tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:31.946918 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-d7a8c5eb-90ed-4e5a-9dff-fc9d9a98318a tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:31.947665 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-d7a8c5eb-90ed-4e5a-9dff-fc9d9a98318a tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:31.948093 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-d7a8c5eb-90ed-4e5a-9dff-fc9d9a98318a tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:32.094164 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-d7a8c5eb-90ed-4e5a-9dff-fc9d9a98318a tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a4c8e15cd44904805c2519c4b6864a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a1542e108d4e3e85fe5525a7e331d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:32.102492 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-d7a8c5eb-90ed-4e5a-9dff-fc9d9a98318a tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] 10.222.0.13 "GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0" status: 200 len: 1756 microversion: 2.1 time: 0.168015 Jun 23 11:56:32.103119 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 585/1162] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:31 2022] GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:33.120662 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-64db26a6-5e02-4d81-8a1a-53125824f7a4 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:33.121305 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-64db26a6-5e02-4d81-8a1a-53125824f7a4 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] [instance: 06c1d69d-fafe-412e-ac84-49c12c6029d0] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:33.128557 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-64db26a6-5e02-4d81-8a1a-53125824f7a4 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:33.129012 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-64db26a6-5e02-4d81-8a1a-53125824f7a4 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:33.130104 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-64db26a6-5e02-4d81-8a1a-53125824f7a4 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:33.130221 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-64db26a6-5e02-4d81-8a1a-53125824f7a4 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:33.275422 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-64db26a6-5e02-4d81-8a1a-53125824f7a4 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a4c8e15cd44904805c2519c4b6864a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a1542e108d4e3e85fe5525a7e331d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:33.283654 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-64db26a6-5e02-4d81-8a1a-53125824f7a4 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] 10.222.0.13 "GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0" status: 200 len: 1756 microversion: 2.1 time: 0.166916 Jun 23 11:56:33.284211 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 578/1163] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:33 2022] GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:34.300042 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-48ab8761-9e76-43c6-8884-3f2088f61739 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:34.300657 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-48ab8761-9e76-43c6-8884-3f2088f61739 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] [instance: 06c1d69d-fafe-412e-ac84-49c12c6029d0] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:34.307337 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-48ab8761-9e76-43c6-8884-3f2088f61739 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:34.307837 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-48ab8761-9e76-43c6-8884-3f2088f61739 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:34.308607 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-48ab8761-9e76-43c6-8884-3f2088f61739 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:34.309042 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-48ab8761-9e76-43c6-8884-3f2088f61739 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:34.452573 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-48ab8761-9e76-43c6-8884-3f2088f61739 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a4c8e15cd44904805c2519c4b6864a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a1542e108d4e3e85fe5525a7e331d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:34.460706 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-48ab8761-9e76-43c6-8884-3f2088f61739 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] 10.222.0.13 "GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0" status: 200 len: 1756 microversion: 2.1 time: 0.164521 Jun 23 11:56:34.461278 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 586/1164] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:34 2022] GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:35.477548 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-ab92f4ef-d269-44f0-b616-4267670ca4dd tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:35.478166 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-ab92f4ef-d269-44f0-b616-4267670ca4dd tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] [instance: 06c1d69d-fafe-412e-ac84-49c12c6029d0] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:35.485454 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ab92f4ef-d269-44f0-b616-4267670ca4dd tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:35.489058 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ab92f4ef-d269-44f0-b616-4267670ca4dd tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:35.489058 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ab92f4ef-d269-44f0-b616-4267670ca4dd tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:35.489058 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ab92f4ef-d269-44f0-b616-4267670ca4dd tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:35.635334 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-ab92f4ef-d269-44f0-b616-4267670ca4dd tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a4c8e15cd44904805c2519c4b6864a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a1542e108d4e3e85fe5525a7e331d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:35.639810 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:35.644736 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-ab92f4ef-d269-44f0-b616-4267670ca4dd tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] 10.222.0.13 "GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0" status: 200 len: 1756 microversion: 2.1 time: 0.171144 Jun 23 11:56:35.645558 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 579/1165] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:35 2022] GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0 => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:36.663875 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-c5d96701-8b4a-4dcd-98a7-8274b2d80590 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:36.664617 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-c5d96701-8b4a-4dcd-98a7-8274b2d80590 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] [instance: 06c1d69d-fafe-412e-ac84-49c12c6029d0] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:36.672021 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-c5d96701-8b4a-4dcd-98a7-8274b2d80590 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:36.675092 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-c5d96701-8b4a-4dcd-98a7-8274b2d80590 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:36.675092 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-c5d96701-8b4a-4dcd-98a7-8274b2d80590 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:36.675092 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-c5d96701-8b4a-4dcd-98a7-8274b2d80590 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:36.823716 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-c5d96701-8b4a-4dcd-98a7-8274b2d80590 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a4c8e15cd44904805c2519c4b6864a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a1542e108d4e3e85fe5525a7e331d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:36.828869 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:36.833937 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-c5d96701-8b4a-4dcd-98a7-8274b2d80590 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] 10.222.0.13 "GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0" status: 200 len: 1756 microversion: 2.1 time: 0.174136 Jun 23 11:56:36.834578 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 587/1166] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:36 2022] GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0 => generated 1756 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:36.899561 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-4797494b-910f-4804-b3f2-b365021c5e53 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:36.900133 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-4797494b-910f-4804-b3f2-b365021c5e53 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] [instance: 4da97884-614a-462c-acfd-09b46602e225] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:36.901619 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [req-d905ca21-1a57-4831-a794-b4fc588c3c4a req-38b8b348-fec1-4910-966d-2fbdd2134619 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4da97884-614a-462c-acfd-09b46602e225", "tag": "1e8cd20b-7797-4fd2-930f-31e718325656"}]} {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:56:36.907854 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-4797494b-910f-4804-b3f2-b365021c5e53 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:36.908433 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-4797494b-910f-4804-b3f2-b365021c5e53 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:36.909358 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-4797494b-910f-4804-b3f2-b365021c5e53 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:36.910025 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-4797494b-910f-4804-b3f2-b365021c5e53 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:36.910212 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-d905ca21-1a57-4831-a794-b4fc588c3c4a req-38b8b348-fec1-4910-966d-2fbdd2134619 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:36.910882 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-d905ca21-1a57-4831-a794-b4fc588c3c4a req-38b8b348-fec1-4910-966d-2fbdd2134619 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:36.926220 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.compute.server_external_events [req-d905ca21-1a57-4831-a794-b4fc588c3c4a req-38b8b348-fec1-4910-966d-2fbdd2134619 service nova] Creating event network-changed:1e8cd20b-7797-4fd2-930f-31e718325656 for instance 4da97884-614a-462c-acfd-09b46602e225 on hv-cinder-82099 Jun 23 11:56:36.935541 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [req-d905ca21-1a57-4831-a794-b4fc588c3c4a req-38b8b348-fec1-4910-966d-2fbdd2134619 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037364 Jun 23 11:56:36.936509 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 588/1167] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:56:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:56:36.940283 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-4797494b-910f-4804-b3f2-b365021c5e53 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] [instance: 4da97884-614a-462c-acfd-09b46602e225] Going to try to terminate instance {{(pid=124669) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 11:56:37.240698 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-4797494b-910f-4804-b3f2-b365021c5e53 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] 10.222.0.13 "DELETE /compute/v2.1/servers/4da97884-614a-462c-acfd-09b46602e225" status: 204 len: 0 microversion: 2.1 time: 0.345236 Jun 23 11:56:37.241789 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 580/1168] 10.222.0.13 () {58 vars in 1238 bytes} [Thu Jun 23 11:56:36 2022] DELETE /compute/v2.1/servers/4da97884-614a-462c-acfd-09b46602e225 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 11:56:37.251955 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-3ac9d43b-6215-40bf-b666-f559174a2cf8 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:37.251955 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-3ac9d43b-6215-40bf-b666-f559174a2cf8 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] [instance: 4da97884-614a-462c-acfd-09b46602e225] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:37.258707 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-3ac9d43b-6215-40bf-b666-f559174a2cf8 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:37.259180 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-3ac9d43b-6215-40bf-b666-f559174a2cf8 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:37.259946 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-3ac9d43b-6215-40bf-b666-f559174a2cf8 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:37.260413 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-3ac9d43b-6215-40bf-b666-f559174a2cf8 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:37.424173 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-3ac9d43b-6215-40bf-b666-f559174a2cf8 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc5a4676f6a416cbdc8c67ebd80cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e810a9bc3b44c4aa8ca2ddd0fa68f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:37.432087 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-3ac9d43b-6215-40bf-b666-f559174a2cf8 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] 10.222.0.13 "GET /compute/v2.1/servers/4da97884-614a-462c-acfd-09b46602e225" status: 200 len: 1576 microversion: 2.1 time: 0.186263 Jun 23 11:56:37.432797 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 589/1169] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:37 2022] GET /compute/v2.1/servers/4da97884-614a-462c-acfd-09b46602e225 => generated 1576 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:37.855276 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-652356c2-a723-4ef0-9bce-69fa79d825c4 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:37.857885 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-652356c2-a723-4ef0-9bce-69fa79d825c4 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] [instance: 06c1d69d-fafe-412e-ac84-49c12c6029d0] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:37.865709 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-652356c2-a723-4ef0-9bce-69fa79d825c4 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:37.866393 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-652356c2-a723-4ef0-9bce-69fa79d825c4 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:37.867187 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-652356c2-a723-4ef0-9bce-69fa79d825c4 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:37.867618 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-652356c2-a723-4ef0-9bce-69fa79d825c4 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:38.027651 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-652356c2-a723-4ef0-9bce-69fa79d825c4 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a4c8e15cd44904805c2519c4b6864a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a1542e108d4e3e85fe5525a7e331d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:38.036443 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-652356c2-a723-4ef0-9bce-69fa79d825c4 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] 10.222.0.13 "GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0" status: 200 len: 1759 microversion: 2.1 time: 0.185681 Jun 23 11:56:38.037019 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 581/1170] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:37 2022] GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0 => generated 1759 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:38.449684 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-1a9b48d9-00c0-4ac5-882b-8918222ea17f tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:38.450410 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-1a9b48d9-00c0-4ac5-882b-8918222ea17f tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] [instance: 4da97884-614a-462c-acfd-09b46602e225] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:38.457919 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1a9b48d9-00c0-4ac5-882b-8918222ea17f tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:38.462153 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1a9b48d9-00c0-4ac5-882b-8918222ea17f tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:38.462153 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1a9b48d9-00c0-4ac5-882b-8918222ea17f tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:38.462153 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1a9b48d9-00c0-4ac5-882b-8918222ea17f tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:38.672988 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-1a9b48d9-00c0-4ac5-882b-8918222ea17f tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc5a4676f6a416cbdc8c67ebd80cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e810a9bc3b44c4aa8ca2ddd0fa68f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:38.680781 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-1a9b48d9-00c0-4ac5-882b-8918222ea17f tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] 10.222.0.13 "GET /compute/v2.1/servers/4da97884-614a-462c-acfd-09b46602e225" status: 200 len: 1457 microversion: 2.1 time: 0.235330 Jun 23 11:56:38.681343 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 590/1171] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:38 2022] GET /compute/v2.1/servers/4da97884-614a-462c-acfd-09b46602e225 => generated 1457 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:38.961256 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [req-f9cc7c18-d9a3-4b56-a5fc-5645c63298e3 req-2cdb1ec6-45f0-4c8e-ae7b-d16215da5a15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4da97884-614a-462c-acfd-09b46602e225", "name": "network-vif-deleted", "tag": "1e8cd20b-7797-4fd2-930f-31e718325656"}]} {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:56:38.970341 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [req-f9cc7c18-d9a3-4b56-a5fc-5645c63298e3 req-2cdb1ec6-45f0-4c8e-ae7b-d16215da5a15 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:38.970808 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [req-f9cc7c18-d9a3-4b56-a5fc-5645c63298e3 req-2cdb1ec6-45f0-4c8e-ae7b-d16215da5a15 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:38.983108 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.compute.server_external_events [req-f9cc7c18-d9a3-4b56-a5fc-5645c63298e3 req-2cdb1ec6-45f0-4c8e-ae7b-d16215da5a15 service nova] Creating event network-vif-deleted:1e8cd20b-7797-4fd2-930f-31e718325656 for instance 4da97884-614a-462c-acfd-09b46602e225 on hv-cinder-82099 Jun 23 11:56:38.987730 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [req-f9cc7c18-d9a3-4b56-a5fc-5645c63298e3 req-2cdb1ec6-45f0-4c8e-ae7b-d16215da5a15 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030128 Jun 23 11:56:38.988340 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 582/1172] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:56:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:56:39.699466 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-15c6aabd-8ff7-4160-a9ee-6e2bef347340 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:39.700003 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-15c6aabd-8ff7-4160-a9ee-6e2bef347340 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] [instance: 4da97884-614a-462c-acfd-09b46602e225] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:39.706848 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-15c6aabd-8ff7-4160-a9ee-6e2bef347340 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:39.707292 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-15c6aabd-8ff7-4160-a9ee-6e2bef347340 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:39.708042 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-15c6aabd-8ff7-4160-a9ee-6e2bef347340 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:39.708555 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-15c6aabd-8ff7-4160-a9ee-6e2bef347340 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:39.774475 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-15c6aabd-8ff7-4160-a9ee-6e2bef347340 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc5a4676f6a416cbdc8c67ebd80cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e810a9bc3b44c4aa8ca2ddd0fa68f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:39.782849 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-15c6aabd-8ff7-4160-a9ee-6e2bef347340 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] 10.222.0.13 "GET /compute/v2.1/servers/4da97884-614a-462c-acfd-09b46602e225" status: 200 len: 1224 microversion: 2.1 time: 0.087222 Jun 23 11:56:39.783409 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 591/1173] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:39 2022] GET /compute/v2.1/servers/4da97884-614a-462c-acfd-09b46602e225 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:40.800833 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-62a71a96-cbf0-4362-820b-a9629ebf8bd8 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:40.801517 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-62a71a96-cbf0-4362-820b-a9629ebf8bd8 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] [instance: 4da97884-614a-462c-acfd-09b46602e225] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:40.807885 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-62a71a96-cbf0-4362-820b-a9629ebf8bd8 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:40.808339 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-62a71a96-cbf0-4362-820b-a9629ebf8bd8 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:40.809096 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-62a71a96-cbf0-4362-820b-a9629ebf8bd8 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:40.809530 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-62a71a96-cbf0-4362-820b-a9629ebf8bd8 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:40.841400 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-62a71a96-cbf0-4362-820b-a9629ebf8bd8 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:40.842800 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-62a71a96-cbf0-4362-820b-a9629ebf8bd8 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:40.843070 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.objects.instance [None req-62a71a96-cbf0-4362-820b-a9629ebf8bd8 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lazy-loading 'fault' on Instance uuid 4da97884-614a-462c-acfd-09b46602e225 {{(pid=124669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:56:40.885010 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-62a71a96-cbf0-4362-820b-a9629ebf8bd8 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc5a4676f6a416cbdc8c67ebd80cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e810a9bc3b44c4aa8ca2ddd0fa68f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:40.893025 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-62a71a96-cbf0-4362-820b-a9629ebf8bd8 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] 10.222.0.13 "GET /compute/v2.1/servers/4da97884-614a-462c-acfd-09b46602e225" status: 200 len: 1229 microversion: 2.1 time: 0.096988 Jun 23 11:56:40.893582 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 583/1174] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:40 2022] GET /compute/v2.1/servers/4da97884-614a-462c-acfd-09b46602e225 => generated 1229 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:41.910801 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-1798f0d0-1856-4488-92f9-b90dfdc34935 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:41.911393 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-1798f0d0-1856-4488-92f9-b90dfdc34935 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] [instance: 4da97884-614a-462c-acfd-09b46602e225] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:41.917846 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1798f0d0-1856-4488-92f9-b90dfdc34935 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:41.918288 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1798f0d0-1856-4488-92f9-b90dfdc34935 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:41.919071 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1798f0d0-1856-4488-92f9-b90dfdc34935 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:41.919499 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1798f0d0-1856-4488-92f9-b90dfdc34935 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:41.949772 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1798f0d0-1856-4488-92f9-b90dfdc34935 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:41.950213 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1798f0d0-1856-4488-92f9-b90dfdc34935 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:41.950674 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.objects.instance [None req-1798f0d0-1856-4488-92f9-b90dfdc34935 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lazy-loading 'fault' on Instance uuid 4da97884-614a-462c-acfd-09b46602e225 {{(pid=124670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:56:41.991966 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-1798f0d0-1856-4488-92f9-b90dfdc34935 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc5a4676f6a416cbdc8c67ebd80cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e810a9bc3b44c4aa8ca2ddd0fa68f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:41.999309 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-1798f0d0-1856-4488-92f9-b90dfdc34935 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] 10.222.0.13 "GET /compute/v2.1/servers/4da97884-614a-462c-acfd-09b46602e225" status: 200 len: 1229 microversion: 2.1 time: 0.092496 Jun 23 11:56:41.999866 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 592/1175] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:41 2022] GET /compute/v2.1/servers/4da97884-614a-462c-acfd-09b46602e225 => generated 1229 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:43.016093 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-d050b6dc-4972-4043-a550-cef8a74de922 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:43.016711 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-d050b6dc-4972-4043-a550-cef8a74de922 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] [instance: 4da97884-614a-462c-acfd-09b46602e225] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:43.023178 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-d050b6dc-4972-4043-a550-cef8a74de922 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:43.023632 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-d050b6dc-4972-4043-a550-cef8a74de922 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:43.024388 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-d050b6dc-4972-4043-a550-cef8a74de922 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:43.024822 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-d050b6dc-4972-4043-a550-cef8a74de922 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:43.055401 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-d050b6dc-4972-4043-a550-cef8a74de922 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:43.055849 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-d050b6dc-4972-4043-a550-cef8a74de922 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:43.056299 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.objects.instance [None req-d050b6dc-4972-4043-a550-cef8a74de922 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lazy-loading 'fault' on Instance uuid 4da97884-614a-462c-acfd-09b46602e225 {{(pid=124669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:56:43.096293 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-d050b6dc-4972-4043-a550-cef8a74de922 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cc5a4676f6a416cbdc8c67ebd80cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e810a9bc3b44c4aa8ca2ddd0fa68f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:43.103648 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-d050b6dc-4972-4043-a550-cef8a74de922 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] 10.222.0.13 "GET /compute/v2.1/servers/4da97884-614a-462c-acfd-09b46602e225" status: 200 len: 1229 microversion: 2.1 time: 0.091521 Jun 23 11:56:43.104209 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 584/1176] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:43 2022] GET /compute/v2.1/servers/4da97884-614a-462c-acfd-09b46602e225 => generated 1229 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:44.121248 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-6a2be017-7d29-474c-9313-2b1f051b2f45 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:44.121782 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-6a2be017-7d29-474c-9313-2b1f051b2f45 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] [instance: 4da97884-614a-462c-acfd-09b46602e225] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:44.128199 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-6a2be017-7d29-474c-9313-2b1f051b2f45 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:44.128648 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-6a2be017-7d29-474c-9313-2b1f051b2f45 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:44.129403 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-6a2be017-7d29-474c-9313-2b1f051b2f45 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:44.129834 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-6a2be017-7d29-474c-9313-2b1f051b2f45 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:44.143525 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.wsgi [None req-6a2be017-7d29-474c-9313-2b1f051b2f45 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] HTTP exception thrown: Instance 4da97884-614a-462c-acfd-09b46602e225 could not be found. Jun 23 11:56:44.148837 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-6a2be017-7d29-474c-9313-2b1f051b2f45 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Request method failure captured: Jun 23 11:56:44.148837 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: request: GET /compute/v2.1/servers/4da97884-614a-462c-acfd-09b46602e225 HTTP/1.1 Jun 23 11:56:44.148837 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Accept: application/json Jun 23 11:56:44.148837 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Accept-Encoding: identity Jun 23 11:56:44.148837 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Connection: close Jun 23 11:56:44.148837 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Content-Length: 0 Jun 23 11:56:44.148837 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Content-Type: application/json Jun 23 11:56:44.148837 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Host: 10.222.0.13 Jun 23 11:56:44.148837 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Openstack-System-Scope: None Jun 23 11:56:44.148837 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: User-Agent: python-urllib3/1.26.9 Jun 23 11:56:44.148837 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Auth-Token: gAAAAABitFKrXJlGv4Y10nZpBqokawq1fsvWINJ6On9pjTbZcDoDz6HvHtwtJWthsDNegb9YIJput0wiweHEs02NPCmIjRC79du2T88hCpYxuEgvtooi0sBEM-VyipUNCAzHQ0gWdAGR_dUjDy3okf2_2yYQDZguvq9NDjINnrdjdvaf9KiLdeA Jun 23 11:56:44.148837 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Domain-Id: None Jun 23 11:56:44.148837 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Domain-Name: None Jun 23 11:56:44.148837 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Identity-Status: Confirmed Jun 23 11:56:44.148837 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Is-Admin-Project: True Jun 23 11:56:44.148837 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Domain-Id: default Jun 23 11:56:44.148837 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Domain-Name: Default Jun 23 11:56:44.148837 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Id: 2e810a9bc3b44c4aa8ca2ddd0fa68f7b Jun 23 11:56:44.148837 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Name: tempest-TestVolumeBootPattern-220427877 Jun 23 11:56:44.148837 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Role: member,reader Jun 23 11:56:44.148837 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Roles: member,reader Jun 23 11:56:44.150609 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2e810a9bc3b44c4aa8ca2ddd0fa68f7b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2e810a9bc3b44c4aa8ca2ddd0fa68f7b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2e810a9bc3b44c4aa8ca2ddd0fa68f7b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2e810a9bc3b44c4aa8ca2ddd0fa68f7b"}]}] Jun 23 11:56:44.150609 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Tenant: tempest-TestVolumeBootPattern-220427877 Jun 23 11:56:44.150609 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Tenant-Id: 2e810a9bc3b44c4aa8ca2ddd0fa68f7b Jun 23 11:56:44.150609 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Tenant-Name: tempest-TestVolumeBootPattern-220427877 Jun 23 11:56:44.150609 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User: tempest-TestVolumeBootPattern-220427877-project Jun 23 11:56:44.150609 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Domain-Id: default Jun 23 11:56:44.150609 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Domain-Name: Default Jun 23 11:56:44.150609 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Id: 6cc5a4676f6a416cbdc8c67ebd80cdf3 Jun 23 11:56:44.150609 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Name: tempest-TestVolumeBootPattern-220427877-project Jun 23 11:56:44.150609 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: method: > Jun 23 11:56:44.150609 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: exception: Instance 4da97884-614a-462c-acfd-09b46602e225 could not be found. Jun 23 11:56:44.150609 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: action_args: {'id': '4da97884-614a-462c-acfd-09b46602e225'} Jun 23 11:56:44.152117 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:56:44.152117 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:56:44.152117 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:56:44.152117 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:56:44.152117 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:56:44.152117 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:56:44.152117 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:56:44.152117 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:56:44.152117 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:56:44.152117 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:56:44.152117 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4da97884-614a-462c-acfd-09b46602e225 could not be found. Jun 23 11:56:44.152117 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:56:44.152117 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:56:44.152117 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:56:44.152117 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:56:44.152117 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:56:44.152117 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:56:44.152117 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:56:44.152117 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:56:44.152117 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:56:44.153696 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:56:44.153696 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 11:56:44.153696 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 11:56:44.153696 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:56:44.153696 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:56:44.153696 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:56:44.153696 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:56:44.153696 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4da97884-614a-462c-acfd-09b46602e225 could not be found. Jun 23 11:56:44.153696 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:56:44.153696 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:56:44.153696 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:56:44.153696 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:56:44.153696 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:56:44.153696 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:56:44.153696 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:56:44.153696 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:56:44.153696 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4da97884-614a-462c-acfd-09b46602e225 could not be found. Jun 23 11:56:44.153696 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:56:44.155862 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-6a2be017-7d29-474c-9313-2b1f051b2f45 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Returning 404 to user: Instance 4da97884-614a-462c-acfd-09b46602e225 could not be found. {{(pid=124670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:56:44.155862 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-6a2be017-7d29-474c-9313-2b1f051b2f45 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] 10.222.0.13 "GET /compute/v2.1/servers/4da97884-614a-462c-acfd-09b46602e225" status: 404 len: 111 microversion: 2.1 time: 0.029231 Jun 23 11:56:44.155862 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 593/1177] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:44 2022] GET /compute/v2.1/servers/4da97884-614a-462c-acfd-09b46602e225 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:56:44.889325 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-474b8077-f071-429c-b755-e53fcb310bdf tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:44.889824 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-474b8077-f071-429c-b755-e53fcb310bdf tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] [instance: 230c27ca-dfe2-4a74-aca7-106c1e5af8fc] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:44.896501 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-474b8077-f071-429c-b755-e53fcb310bdf tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:44.896952 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-474b8077-f071-429c-b755-e53fcb310bdf tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:44.897713 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-474b8077-f071-429c-b755-e53fcb310bdf tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:44.898148 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-474b8077-f071-429c-b755-e53fcb310bdf tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:44.912036 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.wsgi [None req-474b8077-f071-429c-b755-e53fcb310bdf tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] HTTP exception thrown: Instance 230c27ca-dfe2-4a74-aca7-106c1e5af8fc could not be found. Jun 23 11:56:44.913728 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-474b8077-f071-429c-b755-e53fcb310bdf tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Request method failure captured: Jun 23 11:56:44.913728 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: request: DELETE /compute/v2.1/servers/230c27ca-dfe2-4a74-aca7-106c1e5af8fc HTTP/1.1 Jun 23 11:56:44.913728 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Accept: application/json Jun 23 11:56:44.913728 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Accept-Encoding: identity Jun 23 11:56:44.913728 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Connection: close Jun 23 11:56:44.913728 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Content-Length: 0 Jun 23 11:56:44.913728 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Content-Type: application/json Jun 23 11:56:44.913728 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Host: 10.222.0.13 Jun 23 11:56:44.913728 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Openstack-System-Scope: None Jun 23 11:56:44.913728 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: User-Agent: python-urllib3/1.26.9 Jun 23 11:56:44.913728 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Auth-Token: gAAAAABitFKrXJlGv4Y10nZpBqokawq1fsvWINJ6On9pjTbZcDoDz6HvHtwtJWthsDNegb9YIJput0wiweHEs02NPCmIjRC79du2T88hCpYxuEgvtooi0sBEM-VyipUNCAzHQ0gWdAGR_dUjDy3okf2_2yYQDZguvq9NDjINnrdjdvaf9KiLdeA Jun 23 11:56:44.913728 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Domain-Id: None Jun 23 11:56:44.913728 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Domain-Name: None Jun 23 11:56:44.913728 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Identity-Status: Confirmed Jun 23 11:56:44.913728 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Is-Admin-Project: True Jun 23 11:56:44.913728 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Domain-Id: default Jun 23 11:56:44.913728 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Domain-Name: Default Jun 23 11:56:44.913728 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Id: 2e810a9bc3b44c4aa8ca2ddd0fa68f7b Jun 23 11:56:44.913728 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Name: tempest-TestVolumeBootPattern-220427877 Jun 23 11:56:44.913728 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Role: member,reader Jun 23 11:56:44.913728 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Roles: member,reader Jun 23 11:56:44.915412 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2e810a9bc3b44c4aa8ca2ddd0fa68f7b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2e810a9bc3b44c4aa8ca2ddd0fa68f7b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2e810a9bc3b44c4aa8ca2ddd0fa68f7b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2e810a9bc3b44c4aa8ca2ddd0fa68f7b"}]}] Jun 23 11:56:44.915412 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant: tempest-TestVolumeBootPattern-220427877 Jun 23 11:56:44.915412 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant-Id: 2e810a9bc3b44c4aa8ca2ddd0fa68f7b Jun 23 11:56:44.915412 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant-Name: tempest-TestVolumeBootPattern-220427877 Jun 23 11:56:44.915412 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User: tempest-TestVolumeBootPattern-220427877-project Jun 23 11:56:44.915412 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Domain-Id: default Jun 23 11:56:44.915412 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Domain-Name: Default Jun 23 11:56:44.915412 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Id: 6cc5a4676f6a416cbdc8c67ebd80cdf3 Jun 23 11:56:44.915412 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Name: tempest-TestVolumeBootPattern-220427877-project Jun 23 11:56:44.915412 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: method: > Jun 23 11:56:44.915412 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: exception: Instance 230c27ca-dfe2-4a74-aca7-106c1e5af8fc could not be found. Jun 23 11:56:44.915412 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: action_args: {'id': '230c27ca-dfe2-4a74-aca7-106c1e5af8fc'} Jun 23 11:56:44.916368 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:56:44.916368 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:56:44.916368 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:56:44.916368 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:56:44.916368 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:56:44.916368 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:56:44.916368 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:56:44.916368 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:56:44.916368 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:56:44.916368 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:56:44.916368 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 230c27ca-dfe2-4a74-aca7-106c1e5af8fc could not be found. Jun 23 11:56:44.916368 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:56:44.916368 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:56:44.916368 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:56:44.916368 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:56:44.916368 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:56:44.916368 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:56:44.916368 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:56:44.916368 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:56:44.916368 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:56:44.917867 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:56:44.917867 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 11:56:44.917867 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 11:56:44.917867 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 11:56:44.917867 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 11:56:44.917867 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:56:44.917867 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:56:44.917867 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:56:44.917867 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:56:44.917867 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 230c27ca-dfe2-4a74-aca7-106c1e5af8fc could not be found. Jun 23 11:56:44.917867 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:56:44.917867 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:56:44.917867 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:56:44.917867 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:56:44.917867 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:56:44.917867 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:56:44.917867 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:56:44.917867 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:56:44.917867 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 230c27ca-dfe2-4a74-aca7-106c1e5af8fc could not be found. Jun 23 11:56:44.917867 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:56:44.919518 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-474b8077-f071-429c-b755-e53fcb310bdf tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Returning 404 to user: Instance 230c27ca-dfe2-4a74-aca7-106c1e5af8fc could not be found. {{(pid=124669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:56:44.919518 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-474b8077-f071-429c-b755-e53fcb310bdf tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] 10.222.0.13 "DELETE /compute/v2.1/servers/230c27ca-dfe2-4a74-aca7-106c1e5af8fc" status: 404 len: 111 microversion: 2.1 time: 0.029661 Jun 23 11:56:44.919518 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 585/1178] 10.222.0.13 () {58 vars in 1238 bytes} [Thu Jun 23 11:56:44 2022] DELETE /compute/v2.1/servers/230c27ca-dfe2-4a74-aca7-106c1e5af8fc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:56:44.924353 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-f451df2e-30a1-4efc-bd18-5315abb81006 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:44.924948 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-f451df2e-30a1-4efc-bd18-5315abb81006 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] [instance: 230c27ca-dfe2-4a74-aca7-106c1e5af8fc] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:44.931083 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-f451df2e-30a1-4efc-bd18-5315abb81006 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:44.931533 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-f451df2e-30a1-4efc-bd18-5315abb81006 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:44.932327 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-f451df2e-30a1-4efc-bd18-5315abb81006 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:44.932749 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-f451df2e-30a1-4efc-bd18-5315abb81006 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:44.946968 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.wsgi [None req-f451df2e-30a1-4efc-bd18-5315abb81006 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] HTTP exception thrown: Instance 230c27ca-dfe2-4a74-aca7-106c1e5af8fc could not be found. Jun 23 11:56:44.948537 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-f451df2e-30a1-4efc-bd18-5315abb81006 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Request method failure captured: Jun 23 11:56:44.948537 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: request: GET /compute/v2.1/servers/230c27ca-dfe2-4a74-aca7-106c1e5af8fc HTTP/1.1 Jun 23 11:56:44.948537 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Accept: application/json Jun 23 11:56:44.948537 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Accept-Encoding: identity Jun 23 11:56:44.948537 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Connection: close Jun 23 11:56:44.948537 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Content-Length: 0 Jun 23 11:56:44.948537 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Content-Type: application/json Jun 23 11:56:44.948537 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Host: 10.222.0.13 Jun 23 11:56:44.948537 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Openstack-System-Scope: None Jun 23 11:56:44.948537 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: User-Agent: python-urllib3/1.26.9 Jun 23 11:56:44.948537 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Auth-Token: gAAAAABitFKrXJlGv4Y10nZpBqokawq1fsvWINJ6On9pjTbZcDoDz6HvHtwtJWthsDNegb9YIJput0wiweHEs02NPCmIjRC79du2T88hCpYxuEgvtooi0sBEM-VyipUNCAzHQ0gWdAGR_dUjDy3okf2_2yYQDZguvq9NDjINnrdjdvaf9KiLdeA Jun 23 11:56:44.948537 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Domain-Id: None Jun 23 11:56:44.948537 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Domain-Name: None Jun 23 11:56:44.948537 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Identity-Status: Confirmed Jun 23 11:56:44.948537 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Is-Admin-Project: True Jun 23 11:56:44.948537 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Domain-Id: default Jun 23 11:56:44.948537 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Domain-Name: Default Jun 23 11:56:44.948537 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Id: 2e810a9bc3b44c4aa8ca2ddd0fa68f7b Jun 23 11:56:44.948537 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Name: tempest-TestVolumeBootPattern-220427877 Jun 23 11:56:44.948537 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Role: member,reader Jun 23 11:56:44.948537 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Roles: member,reader Jun 23 11:56:44.953120 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2e810a9bc3b44c4aa8ca2ddd0fa68f7b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2e810a9bc3b44c4aa8ca2ddd0fa68f7b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2e810a9bc3b44c4aa8ca2ddd0fa68f7b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2e810a9bc3b44c4aa8ca2ddd0fa68f7b"}]}] Jun 23 11:56:44.953120 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Tenant: tempest-TestVolumeBootPattern-220427877 Jun 23 11:56:44.953120 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Tenant-Id: 2e810a9bc3b44c4aa8ca2ddd0fa68f7b Jun 23 11:56:44.953120 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Tenant-Name: tempest-TestVolumeBootPattern-220427877 Jun 23 11:56:44.953120 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User: tempest-TestVolumeBootPattern-220427877-project Jun 23 11:56:44.953120 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Domain-Id: default Jun 23 11:56:44.953120 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Domain-Name: Default Jun 23 11:56:44.953120 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Id: 6cc5a4676f6a416cbdc8c67ebd80cdf3 Jun 23 11:56:44.953120 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Name: tempest-TestVolumeBootPattern-220427877-project Jun 23 11:56:44.953120 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: method: > Jun 23 11:56:44.953120 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: exception: Instance 230c27ca-dfe2-4a74-aca7-106c1e5af8fc could not be found. Jun 23 11:56:44.953120 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: action_args: {'id': '230c27ca-dfe2-4a74-aca7-106c1e5af8fc'} Jun 23 11:56:44.954274 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:56:44.954274 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:56:44.954274 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:56:44.954274 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:56:44.954274 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:56:44.954274 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:56:44.954274 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:56:44.954274 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:56:44.954274 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:56:44.954274 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:56:44.954274 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 230c27ca-dfe2-4a74-aca7-106c1e5af8fc could not be found. Jun 23 11:56:44.954274 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:56:44.954274 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:56:44.954274 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:56:44.954274 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:56:44.954274 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:56:44.954274 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:56:44.954274 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:56:44.954274 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:56:44.954274 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:56:44.955657 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:56:44.955657 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 11:56:44.955657 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 11:56:44.955657 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:56:44.955657 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:56:44.955657 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:56:44.955657 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:56:44.955657 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 230c27ca-dfe2-4a74-aca7-106c1e5af8fc could not be found. Jun 23 11:56:44.955657 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:56:44.955657 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:56:44.955657 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:56:44.955657 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:56:44.955657 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:56:44.955657 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:56:44.955657 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:56:44.955657 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:56:44.955657 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 230c27ca-dfe2-4a74-aca7-106c1e5af8fc could not be found. Jun 23 11:56:44.955657 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:56:44.956827 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-f451df2e-30a1-4efc-bd18-5315abb81006 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Returning 404 to user: Instance 230c27ca-dfe2-4a74-aca7-106c1e5af8fc could not be found. {{(pid=124670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:56:44.956827 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-f451df2e-30a1-4efc-bd18-5315abb81006 tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] 10.222.0.13 "GET /compute/v2.1/servers/230c27ca-dfe2-4a74-aca7-106c1e5af8fc" status: 404 len: 111 microversion: 2.1 time: 0.030110 Jun 23 11:56:44.956827 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 594/1179] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:44 2022] GET /compute/v2.1/servers/230c27ca-dfe2-4a74-aca7-106c1e5af8fc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 23 11:56:49.642806 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-1bf9e271-8895-4c6d-8873-a4d8d0d2e3eb tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] Calling method '.version_select at 0x7f5d06fab4c0>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:49.664413 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=2 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:49.715465 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-fa38e59b-fc8f-4d65-b751-36447a6c344f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:49.716388 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-fa38e59b-fc8f-4d65-b751-36447a6c344f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:49.719181 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_api:SELECT=51 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:49.724223 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-fa38e59b-fc8f-4d65-b751-36447a6c344f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:49.724680 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-fa38e59b-fc8f-4d65-b751-36447a6c344f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:49.725454 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-fa38e59b-fc8f-4d65-b751-36447a6c344f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:49.725891 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-fa38e59b-fc8f-4d65-b751-36447a6c344f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:49.760496 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-1bf9e271-8895-4c6d-8873-a4d8d0d2e3eb tempest-TestVolumeBootPattern-220427877 tempest-TestVolumeBootPattern-220427877-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-367548420" status: 202 len: 0 microversion: 2.1 time: 0.120956 Jun 23 11:56:49.760649 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-fa38e59b-fc8f-4d65-b751-36447a6c344f tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048907 Jun 23 11:56:49.761158 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 595/1180] 10.222.0.13 () {60 vars in 1342 bytes} [Thu Jun 23 11:56:49 2022] GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:56:49.762081 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 586/1181] 10.222.0.13 () {58 vars in 1259 bytes} [Thu Jun 23 11:56:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-367548420 => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 11:56:49.828770 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-0d2034dd-c308-40ae-8a79-355f45cb13ee tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:49.828770 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-0d2034dd-c308-40ae-8a79-355f45cb13ee tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:49.845676 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-0d2034dd-c308-40ae-8a79-355f45cb13ee tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:49.846139 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-0d2034dd-c308-40ae-8a79-355f45cb13ee tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:49.847014 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-0d2034dd-c308-40ae-8a79-355f45cb13ee tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:49.847459 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-0d2034dd-c308-40ae-8a79-355f45cb13ee tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:49.891117 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-0d2034dd-c308-40ae-8a79-355f45cb13ee tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Going to try to terminate instance {{(pid=124670) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 11:56:50.141598 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-0d2034dd-c308-40ae-8a79-355f45cb13ee tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "DELETE /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143" status: 204 len: 0 microversion: 2.20 time: 0.319478 Jun 23 11:56:50.142769 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 596/1182] 10.222.0.13 () {60 vars in 1279 bytes} [Thu Jun 23 11:56:49 2022] DELETE /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 23 11:56:50.151055 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-b83ac2aa-8d7b-4750-b03d-12ab6ec52426 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:50.151670 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-b83ac2aa-8d7b-4750-b03d-12ab6ec52426 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:50.158950 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-b83ac2aa-8d7b-4750-b03d-12ab6ec52426 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:50.159424 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-b83ac2aa-8d7b-4750-b03d-12ab6ec52426 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:50.160365 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-b83ac2aa-8d7b-4750-b03d-12ab6ec52426 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:50.161068 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-b83ac2aa-8d7b-4750-b03d-12ab6ec52426 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:50.379293 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-b83ac2aa-8d7b-4750-b03d-12ab6ec52426 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:50.387257 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-b83ac2aa-8d7b-4750-b03d-12ab6ec52426 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:50.388750 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-b83ac2aa-8d7b-4750-b03d-12ab6ec52426 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:50.389939 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-b83ac2aa-8d7b-4750-b03d-12ab6ec52426 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143" status: 200 len: 1725 microversion: 2.20 time: 0.243343 Jun 23 11:56:50.390491 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 587/1183] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:56:50 2022] GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 => generated 1725 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:56:51.408963 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-3dc45c5d-87c3-4a1b-ba48-0fec56292315 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:51.409667 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-3dc45c5d-87c3-4a1b-ba48-0fec56292315 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:51.415697 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-3dc45c5d-87c3-4a1b-ba48-0fec56292315 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:51.416147 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-3dc45c5d-87c3-4a1b-ba48-0fec56292315 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:51.417098 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-3dc45c5d-87c3-4a1b-ba48-0fec56292315 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:51.417532 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-3dc45c5d-87c3-4a1b-ba48-0fec56292315 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:51.612899 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-3dc45c5d-87c3-4a1b-ba48-0fec56292315 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:51.622168 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-3dc45c5d-87c3-4a1b-ba48-0fec56292315 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:51.623813 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-3dc45c5d-87c3-4a1b-ba48-0fec56292315 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:51.625672 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-3dc45c5d-87c3-4a1b-ba48-0fec56292315 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143" status: 200 len: 1725 microversion: 2.20 time: 0.221494 Jun 23 11:56:51.626224 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 597/1184] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:56:51 2022] GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 => generated 1725 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:56:52.644128 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-69c7f209-440f-46ed-9f8c-ca87a8e5be5a tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:52.644889 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-69c7f209-440f-46ed-9f8c-ca87a8e5be5a tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:52.651284 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-69c7f209-440f-46ed-9f8c-ca87a8e5be5a tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:52.651742 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-69c7f209-440f-46ed-9f8c-ca87a8e5be5a tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:52.652515 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-69c7f209-440f-46ed-9f8c-ca87a8e5be5a tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:52.652956 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-69c7f209-440f-46ed-9f8c-ca87a8e5be5a tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:52.816574 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-69c7f209-440f-46ed-9f8c-ca87a8e5be5a tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:52.825322 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-69c7f209-440f-46ed-9f8c-ca87a8e5be5a tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:52.826867 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-69c7f209-440f-46ed-9f8c-ca87a8e5be5a tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:52.830028 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-69c7f209-440f-46ed-9f8c-ca87a8e5be5a tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143" status: 200 len: 1725 microversion: 2.20 time: 0.190219 Jun 23 11:56:52.832024 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 588/1185] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:56:52 2022] GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 => generated 1725 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:56:53.285603 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [req-42847626-3896-4d49-97f7-320a5c49f892 req-4cc9c142-5616-44ea-9104-478390210e93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e51258d-c99d-4d15-8463-c699bcfa9143", "name": "network-vif-deleted", "tag": "2fc09618-5ffd-4c12-8072-c756814d925d"}]} {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:56:53.307781 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-42847626-3896-4d49-97f7-320a5c49f892 req-4cc9c142-5616-44ea-9104-478390210e93 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:53.308529 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-42847626-3896-4d49-97f7-320a5c49f892 req-4cc9c142-5616-44ea-9104-478390210e93 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:53.328299 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.compute.server_external_events [req-42847626-3896-4d49-97f7-320a5c49f892 req-4cc9c142-5616-44ea-9104-478390210e93 service nova] Creating event network-vif-deleted:2fc09618-5ffd-4c12-8072-c756814d925d for instance 1e51258d-c99d-4d15-8463-c699bcfa9143 on hv-cinder-82099 Jun 23 11:56:53.344074 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [req-42847626-3896-4d49-97f7-320a5c49f892 req-4cc9c142-5616-44ea-9104-478390210e93 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059500 Jun 23 11:56:53.344074 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 598/1186] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:56:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:56:53.853132 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-496a86df-36ff-4540-903d-4756ca33a5fb tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:53.853752 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-496a86df-36ff-4540-903d-4756ca33a5fb tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:53.867929 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-496a86df-36ff-4540-903d-4756ca33a5fb tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:53.879011 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-496a86df-36ff-4540-903d-4756ca33a5fb tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:53.889433 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-496a86df-36ff-4540-903d-4756ca33a5fb tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:53.890443 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-496a86df-36ff-4540-903d-4756ca33a5fb tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:53.956001 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-496a86df-36ff-4540-903d-4756ca33a5fb tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:53.956735 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-496a86df-36ff-4540-903d-4756ca33a5fb tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:53.957359 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.objects.instance [None req-496a86df-36ff-4540-903d-4756ca33a5fb tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lazy-loading 'fault' on Instance uuid 1e51258d-c99d-4d15-8463-c699bcfa9143 {{(pid=124669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:56:54.022021 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-496a86df-36ff-4540-903d-4756ca33a5fb tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:54.032804 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-496a86df-36ff-4540-903d-4756ca33a5fb tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:54.036470 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-496a86df-36ff-4540-903d-4756ca33a5fb tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '41cb2b9a5156470aaeca9cc10f402ef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0275f5304e4d9eae19c46a4f161217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:54.038384 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-496a86df-36ff-4540-903d-4756ca33a5fb tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143" status: 200 len: 1371 microversion: 2.20 time: 0.193975 Jun 23 11:56:54.039521 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 589/1187] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:56:53 2022] GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 => generated 1371 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:56:55.065202 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-883fdb41-4897-4bd8-b4ec-1f124e447b30 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:55.065202 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-883fdb41-4897-4bd8-b4ec-1f124e447b30 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:55.071214 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-883fdb41-4897-4bd8-b4ec-1f124e447b30 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:55.072100 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-883fdb41-4897-4bd8-b4ec-1f124e447b30 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:55.073102 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-883fdb41-4897-4bd8-b4ec-1f124e447b30 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:55.073543 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-883fdb41-4897-4bd8-b4ec-1f124e447b30 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:55.092345 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.wsgi [None req-883fdb41-4897-4bd8-b4ec-1f124e447b30 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] HTTP exception thrown: Instance 1e51258d-c99d-4d15-8463-c699bcfa9143 could not be found. Jun 23 11:56:55.094256 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-883fdb41-4897-4bd8-b4ec-1f124e447b30 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Request method failure captured: Jun 23 11:56:55.094256 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: request: GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 HTTP/1.1 Jun 23 11:56:55.094256 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Accept: application/json Jun 23 11:56:55.094256 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Accept-Encoding: identity Jun 23 11:56:55.094256 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Connection: close Jun 23 11:56:55.094256 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Content-Length: 0 Jun 23 11:56:55.094256 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Content-Type: application/json Jun 23 11:56:55.094256 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Host: 10.222.0.13 Jun 23 11:56:55.094256 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Openstack-System-Scope: None Jun 23 11:56:55.094256 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: User-Agent: python-urllib3/1.26.9 Jun 23 11:56:55.094256 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Auth-Token: gAAAAABitFKDO5UVobueQEQJ2YUHyncwckPaMgzyz_wvVEuptm8ae8DuBcodoQfFFPUmC1_B0Lg7tYFC0jL381L-1yVrhssvsKzevNvrbuMLiy9lOFiuw0Q1_NfG6KuVGkpedL76osllJXZ4E_neeeSEGUBNvd0Sh_8DFxFul8ZEUwsfBt9U_Hc Jun 23 11:56:55.094256 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Domain-Id: None Jun 23 11:56:55.094256 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Domain-Name: None Jun 23 11:56:55.094256 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Identity-Status: Confirmed Jun 23 11:56:55.094256 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Is-Admin-Project: True Jun 23 11:56:55.094256 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Openstack-Nova-Api-Version: 2.20 Jun 23 11:56:55.094256 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Domain-Id: default Jun 23 11:56:55.094256 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Domain-Name: Default Jun 23 11:56:55.094256 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Id: 4c0275f5304e4d9eae19c46a4f161217 Jun 23 11:56:55.094256 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1670293014 Jun 23 11:56:55.094256 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Role: member,reader Jun 23 11:56:55.094256 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Roles: member,reader Jun 23 11:56:55.095893 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4c0275f5304e4d9eae19c46a4f161217"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4c0275f5304e4d9eae19c46a4f161217"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4c0275f5304e4d9eae19c46a4f161217"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4c0275f5304e4d9eae19c46a4f161217"}]}] Jun 23 11:56:55.095893 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1670293014 Jun 23 11:56:55.095893 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Tenant-Id: 4c0275f5304e4d9eae19c46a4f161217 Jun 23 11:56:55.095893 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1670293014 Jun 23 11:56:55.095893 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User: tempest-AttachVolumeShelveTestJSON-1670293014-project Jun 23 11:56:55.095893 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Domain-Id: default Jun 23 11:56:55.095893 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Domain-Name: Default Jun 23 11:56:55.095893 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Id: 41cb2b9a5156470aaeca9cc10f402ef9 Jun 23 11:56:55.095893 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1670293014-project Jun 23 11:56:55.095893 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: method: > Jun 23 11:56:55.095893 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: exception: Instance 1e51258d-c99d-4d15-8463-c699bcfa9143 could not be found. Jun 23 11:56:55.095893 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: action_args: {'id': '1e51258d-c99d-4d15-8463-c699bcfa9143'} Jun 23 11:56:55.096710 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:56:55.096710 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:56:55.096710 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:56:55.096710 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:56:55.096710 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:56:55.096710 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:56:55.096710 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:56:55.096710 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:56:55.096710 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:56:55.096710 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:56:55.096710 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e51258d-c99d-4d15-8463-c699bcfa9143 could not be found. Jun 23 11:56:55.096710 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:56:55.096710 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:56:55.096710 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:56:55.096710 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:56:55.096710 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:56:55.096710 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:56:55.096710 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:56:55.096710 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:56:55.096710 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:56:55.098170 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:56:55.098170 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 11:56:55.098170 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 11:56:55.098170 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:56:55.098170 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:56:55.098170 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:56:55.098170 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:56:55.098170 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e51258d-c99d-4d15-8463-c699bcfa9143 could not be found. Jun 23 11:56:55.098170 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:56:55.098170 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:56:55.098170 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:56:55.098170 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:56:55.098170 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:56:55.098170 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:56:55.098170 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:56:55.098170 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:56:55.098170 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e51258d-c99d-4d15-8463-c699bcfa9143 could not be found. Jun 23 11:56:55.098170 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:56:55.099496 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-883fdb41-4897-4bd8-b4ec-1f124e447b30 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Returning 404 to user: Instance 1e51258d-c99d-4d15-8463-c699bcfa9143 could not be found. {{(pid=124670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:56:55.099496 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-883fdb41-4897-4bd8-b4ec-1f124e447b30 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143" status: 404 len: 111 microversion: 2.20 time: 0.042942 Jun 23 11:56:55.099496 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 599/1188] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:56:55 2022] GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 23 11:56:55.107158 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-b4409e36-ce55-45a3-ba39-5cf4170074ff tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '.version_select at 0x7f5d06fdd9d0>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:55.198431 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-b4409e36-ce55-45a3-ba39-5cf4170074ff tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-741569791" status: 204 len: 0 microversion: 2.20 time: 0.096816 Jun 23 11:56:55.199097 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 590/1189] 10.222.0.13 () {60 vars in 1258 bytes} [Thu Jun 23 11:56:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-741569791 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 23 11:56:57.759434 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-8e6356c7-1257-4ae9-ad17-273fc31ca722 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:57.760130 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-8e6356c7-1257-4ae9-ad17-273fc31ca722 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:57.778161 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-8e6356c7-1257-4ae9-ad17-273fc31ca722 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:57.778161 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-8e6356c7-1257-4ae9-ad17-273fc31ca722 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:57.778800 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-8e6356c7-1257-4ae9-ad17-273fc31ca722 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:57.779524 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-8e6356c7-1257-4ae9-ad17-273fc31ca722 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:57.817528 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.wsgi [None req-8e6356c7-1257-4ae9-ad17-273fc31ca722 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] HTTP exception thrown: Instance 1e51258d-c99d-4d15-8463-c699bcfa9143 could not be found. Jun 23 11:56:57.819750 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-8e6356c7-1257-4ae9-ad17-273fc31ca722 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Request method failure captured: Jun 23 11:56:57.819750 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: request: DELETE /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 HTTP/1.1 Jun 23 11:56:57.819750 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Accept: application/json Jun 23 11:56:57.819750 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Accept-Encoding: identity Jun 23 11:56:57.819750 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Connection: close Jun 23 11:56:57.819750 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Content-Length: 0 Jun 23 11:56:57.819750 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Content-Type: application/json Jun 23 11:56:57.819750 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Host: 10.222.0.13 Jun 23 11:56:57.819750 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Openstack-System-Scope: None Jun 23 11:56:57.819750 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: User-Agent: python-urllib3/1.26.9 Jun 23 11:56:57.819750 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Auth-Token: gAAAAABitFKDO5UVobueQEQJ2YUHyncwckPaMgzyz_wvVEuptm8ae8DuBcodoQfFFPUmC1_B0Lg7tYFC0jL381L-1yVrhssvsKzevNvrbuMLiy9lOFiuw0Q1_NfG6KuVGkpedL76osllJXZ4E_neeeSEGUBNvd0Sh_8DFxFul8ZEUwsfBt9U_Hc Jun 23 11:56:57.819750 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Domain-Id: None Jun 23 11:56:57.819750 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Domain-Name: None Jun 23 11:56:57.819750 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Identity-Status: Confirmed Jun 23 11:56:57.819750 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Is-Admin-Project: True Jun 23 11:56:57.819750 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Openstack-Nova-Api-Version: 2.20 Jun 23 11:56:57.819750 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Domain-Id: default Jun 23 11:56:57.819750 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Domain-Name: Default Jun 23 11:56:57.819750 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Id: 4c0275f5304e4d9eae19c46a4f161217 Jun 23 11:56:57.819750 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1670293014 Jun 23 11:56:57.819750 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Role: member,reader Jun 23 11:56:57.819750 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Roles: member,reader Jun 23 11:56:57.824691 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4c0275f5304e4d9eae19c46a4f161217"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4c0275f5304e4d9eae19c46a4f161217"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4c0275f5304e4d9eae19c46a4f161217"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4c0275f5304e4d9eae19c46a4f161217"}]}] Jun 23 11:56:57.824691 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1670293014 Jun 23 11:56:57.824691 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Tenant-Id: 4c0275f5304e4d9eae19c46a4f161217 Jun 23 11:56:57.824691 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1670293014 Jun 23 11:56:57.824691 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User: tempest-AttachVolumeShelveTestJSON-1670293014-project Jun 23 11:56:57.824691 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Domain-Id: default Jun 23 11:56:57.824691 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Domain-Name: Default Jun 23 11:56:57.824691 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Id: 41cb2b9a5156470aaeca9cc10f402ef9 Jun 23 11:56:57.824691 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1670293014-project Jun 23 11:56:57.824691 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: method: > Jun 23 11:56:57.824691 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: exception: Instance 1e51258d-c99d-4d15-8463-c699bcfa9143 could not be found. Jun 23 11:56:57.824691 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: action_args: {'id': '1e51258d-c99d-4d15-8463-c699bcfa9143'} Jun 23 11:56:57.825744 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:56:57.825744 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:56:57.825744 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:56:57.825744 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:56:57.825744 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:56:57.825744 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:56:57.825744 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:56:57.825744 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:56:57.825744 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:56:57.825744 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:56:57.825744 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e51258d-c99d-4d15-8463-c699bcfa9143 could not be found. Jun 23 11:56:57.825744 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:56:57.825744 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:56:57.825744 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:56:57.825744 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:56:57.825744 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:56:57.825744 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:56:57.825744 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:56:57.825744 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:56:57.825744 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:56:57.827971 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:56:57.827971 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 11:56:57.827971 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 11:56:57.827971 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 11:56:57.827971 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 11:56:57.827971 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:56:57.827971 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:56:57.827971 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:56:57.827971 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:56:57.827971 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e51258d-c99d-4d15-8463-c699bcfa9143 could not be found. Jun 23 11:56:57.827971 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:56:57.827971 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:56:57.827971 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:56:57.827971 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:56:57.827971 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:56:57.827971 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:56:57.827971 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:56:57.827971 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:56:57.827971 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e51258d-c99d-4d15-8463-c699bcfa9143 could not be found. Jun 23 11:56:57.827971 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:56:57.831521 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-8e6356c7-1257-4ae9-ad17-273fc31ca722 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Returning 404 to user: Instance 1e51258d-c99d-4d15-8463-c699bcfa9143 could not be found. {{(pid=124670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:56:57.832576 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-8e6356c7-1257-4ae9-ad17-273fc31ca722 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "DELETE /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143" status: 404 len: 111 microversion: 2.20 time: 0.078592 Jun 23 11:56:57.833466 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 600/1190] 10.222.0.13 () {60 vars in 1279 bytes} [Thu Jun 23 11:56:57 2022] DELETE /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 23 11:56:57.842033 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-6c4cbea6-13c2-4844-9838-084c90f2fa09 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:57.842807 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-6c4cbea6-13c2-4844-9838-084c90f2fa09 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: 1e51258d-c99d-4d15-8463-c699bcfa9143] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:57.850476 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-6c4cbea6-13c2-4844-9838-084c90f2fa09 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:57.850964 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-6c4cbea6-13c2-4844-9838-084c90f2fa09 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:57.851729 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-6c4cbea6-13c2-4844-9838-084c90f2fa09 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:57.852166 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-6c4cbea6-13c2-4844-9838-084c90f2fa09 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:57.870339 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.wsgi [None req-6c4cbea6-13c2-4844-9838-084c90f2fa09 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] HTTP exception thrown: Instance 1e51258d-c99d-4d15-8463-c699bcfa9143 could not be found. Jun 23 11:56:57.871826 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-6c4cbea6-13c2-4844-9838-084c90f2fa09 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Request method failure captured: Jun 23 11:56:57.871826 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: request: GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 HTTP/1.1 Jun 23 11:56:57.871826 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Accept: application/json Jun 23 11:56:57.871826 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Accept-Encoding: identity Jun 23 11:56:57.871826 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Connection: close Jun 23 11:56:57.871826 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Content-Length: 0 Jun 23 11:56:57.871826 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Content-Type: application/json Jun 23 11:56:57.871826 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Host: 10.222.0.13 Jun 23 11:56:57.871826 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Openstack-System-Scope: None Jun 23 11:56:57.871826 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: User-Agent: python-urllib3/1.26.9 Jun 23 11:56:57.871826 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Auth-Token: gAAAAABitFKDO5UVobueQEQJ2YUHyncwckPaMgzyz_wvVEuptm8ae8DuBcodoQfFFPUmC1_B0Lg7tYFC0jL381L-1yVrhssvsKzevNvrbuMLiy9lOFiuw0Q1_NfG6KuVGkpedL76osllJXZ4E_neeeSEGUBNvd0Sh_8DFxFul8ZEUwsfBt9U_Hc Jun 23 11:56:57.871826 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Domain-Id: None Jun 23 11:56:57.871826 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Domain-Name: None Jun 23 11:56:57.871826 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Identity-Status: Confirmed Jun 23 11:56:57.871826 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Is-Admin-Project: True Jun 23 11:56:57.871826 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Openstack-Nova-Api-Version: 2.20 Jun 23 11:56:57.871826 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Domain-Id: default Jun 23 11:56:57.871826 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Domain-Name: Default Jun 23 11:56:57.871826 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Id: 4c0275f5304e4d9eae19c46a4f161217 Jun 23 11:56:57.871826 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1670293014 Jun 23 11:56:57.871826 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Role: member,reader Jun 23 11:56:57.871826 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Roles: member,reader Jun 23 11:56:57.873586 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4c0275f5304e4d9eae19c46a4f161217"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4c0275f5304e4d9eae19c46a4f161217"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4c0275f5304e4d9eae19c46a4f161217"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4c0275f5304e4d9eae19c46a4f161217"}]}] Jun 23 11:56:57.873586 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1670293014 Jun 23 11:56:57.873586 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant-Id: 4c0275f5304e4d9eae19c46a4f161217 Jun 23 11:56:57.873586 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1670293014 Jun 23 11:56:57.873586 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User: tempest-AttachVolumeShelveTestJSON-1670293014-project Jun 23 11:56:57.873586 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Domain-Id: default Jun 23 11:56:57.873586 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Domain-Name: Default Jun 23 11:56:57.873586 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Id: 41cb2b9a5156470aaeca9cc10f402ef9 Jun 23 11:56:57.873586 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1670293014-project Jun 23 11:56:57.873586 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: method: > Jun 23 11:56:57.873586 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: exception: Instance 1e51258d-c99d-4d15-8463-c699bcfa9143 could not be found. Jun 23 11:56:57.873586 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: action_args: {'id': '1e51258d-c99d-4d15-8463-c699bcfa9143'} Jun 23 11:56:57.875095 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:56:57.875095 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:56:57.875095 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:56:57.875095 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:56:57.875095 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:56:57.875095 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:56:57.875095 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:56:57.875095 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:56:57.875095 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:56:57.875095 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:56:57.875095 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e51258d-c99d-4d15-8463-c699bcfa9143 could not be found. Jun 23 11:56:57.875095 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:56:57.875095 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:56:57.875095 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:56:57.875095 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:56:57.875095 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:56:57.875095 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:56:57.875095 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:56:57.875095 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:56:57.875095 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:56:57.876670 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:56:57.876670 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 11:56:57.876670 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 11:56:57.876670 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:56:57.876670 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:56:57.876670 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:56:57.876670 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:56:57.876670 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e51258d-c99d-4d15-8463-c699bcfa9143 could not be found. Jun 23 11:56:57.876670 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:56:57.876670 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:56:57.876670 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:56:57.876670 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:56:57.876670 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:56:57.876670 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:56:57.876670 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:56:57.876670 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:56:57.876670 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e51258d-c99d-4d15-8463-c699bcfa9143 could not be found. Jun 23 11:56:57.876670 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:56:57.879035 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-6c4cbea6-13c2-4844-9838-084c90f2fa09 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Returning 404 to user: Instance 1e51258d-c99d-4d15-8463-c699bcfa9143 could not be found. {{(pid=124669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:56:57.881974 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-6c4cbea6-13c2-4844-9838-084c90f2fa09 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143" status: 404 len: 111 microversion: 2.20 time: 0.042391 Jun 23 11:56:57.881974 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 591/1191] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:56:57 2022] GET /compute/v2.1/servers/1e51258d-c99d-4d15-8463-c699bcfa9143 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 23 11:56:59.231760 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-4752bc99-972b-494b-a19a-cd8d39ab8967 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:59.232266 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-4752bc99-972b-494b-a19a-cd8d39ab8967 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:59.238813 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-4752bc99-972b-494b-a19a-cd8d39ab8967 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:59.239260 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-4752bc99-972b-494b-a19a-cd8d39ab8967 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:59.240030 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-4752bc99-972b-494b-a19a-cd8d39ab8967 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:59.240538 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-4752bc99-972b-494b-a19a-cd8d39ab8967 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:59.254707 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.wsgi [None req-4752bc99-972b-494b-a19a-cd8d39ab8967 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] HTTP exception thrown: Instance d9e98590-5036-4ade-bbba-f743256ac961 could not be found. Jun 23 11:56:59.256318 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-4752bc99-972b-494b-a19a-cd8d39ab8967 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Request method failure captured: Jun 23 11:56:59.256318 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: request: DELETE /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 HTTP/1.1 Jun 23 11:56:59.256318 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Accept: application/json Jun 23 11:56:59.256318 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Accept-Encoding: identity Jun 23 11:56:59.256318 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Connection: close Jun 23 11:56:59.256318 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Content-Length: 0 Jun 23 11:56:59.256318 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Content-Type: application/json Jun 23 11:56:59.256318 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Host: 10.222.0.13 Jun 23 11:56:59.256318 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Openstack-System-Scope: None Jun 23 11:56:59.256318 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: User-Agent: python-urllib3/1.26.9 Jun 23 11:56:59.256318 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Auth-Token: gAAAAABitFKDO5UVobueQEQJ2YUHyncwckPaMgzyz_wvVEuptm8ae8DuBcodoQfFFPUmC1_B0Lg7tYFC0jL381L-1yVrhssvsKzevNvrbuMLiy9lOFiuw0Q1_NfG6KuVGkpedL76osllJXZ4E_neeeSEGUBNvd0Sh_8DFxFul8ZEUwsfBt9U_Hc Jun 23 11:56:59.256318 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Domain-Id: None Jun 23 11:56:59.256318 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Domain-Name: None Jun 23 11:56:59.256318 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Identity-Status: Confirmed Jun 23 11:56:59.256318 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Is-Admin-Project: True Jun 23 11:56:59.256318 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Openstack-Nova-Api-Version: 2.20 Jun 23 11:56:59.256318 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Domain-Id: default Jun 23 11:56:59.256318 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Domain-Name: Default Jun 23 11:56:59.256318 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Id: 4c0275f5304e4d9eae19c46a4f161217 Jun 23 11:56:59.256318 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1670293014 Jun 23 11:56:59.256318 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Role: member,reader Jun 23 11:56:59.256318 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Roles: member,reader Jun 23 11:56:59.258140 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4c0275f5304e4d9eae19c46a4f161217"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4c0275f5304e4d9eae19c46a4f161217"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4c0275f5304e4d9eae19c46a4f161217"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4c0275f5304e4d9eae19c46a4f161217"}]}] Jun 23 11:56:59.258140 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1670293014 Jun 23 11:56:59.258140 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Tenant-Id: 4c0275f5304e4d9eae19c46a4f161217 Jun 23 11:56:59.258140 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1670293014 Jun 23 11:56:59.258140 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User: tempest-AttachVolumeShelveTestJSON-1670293014-project Jun 23 11:56:59.258140 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Domain-Id: default Jun 23 11:56:59.258140 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Domain-Name: Default Jun 23 11:56:59.258140 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Id: 41cb2b9a5156470aaeca9cc10f402ef9 Jun 23 11:56:59.258140 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1670293014-project Jun 23 11:56:59.258140 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: method: > Jun 23 11:56:59.258140 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: exception: Instance d9e98590-5036-4ade-bbba-f743256ac961 could not be found. Jun 23 11:56:59.258140 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: action_args: {'id': 'd9e98590-5036-4ade-bbba-f743256ac961'} Jun 23 11:56:59.263665 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:56:59.263665 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:56:59.263665 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:56:59.263665 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:56:59.263665 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:56:59.263665 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:56:59.263665 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:56:59.263665 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:56:59.263665 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:56:59.263665 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:56:59.263665 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9e98590-5036-4ade-bbba-f743256ac961 could not be found. Jun 23 11:56:59.263665 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:56:59.263665 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:56:59.263665 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:56:59.263665 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:56:59.263665 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:56:59.263665 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:56:59.263665 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:56:59.263665 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:56:59.263665 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:56:59.266098 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:56:59.266098 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 11:56:59.266098 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 11:56:59.266098 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 11:56:59.266098 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 11:56:59.266098 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:56:59.266098 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:56:59.266098 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:56:59.266098 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:56:59.266098 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9e98590-5036-4ade-bbba-f743256ac961 could not be found. Jun 23 11:56:59.266098 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:56:59.266098 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:56:59.266098 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:56:59.266098 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:56:59.266098 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:56:59.266098 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:56:59.266098 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:56:59.266098 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:56:59.266098 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9e98590-5036-4ade-bbba-f743256ac961 could not be found. Jun 23 11:56:59.266098 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:56:59.267735 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-4752bc99-972b-494b-a19a-cd8d39ab8967 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Returning 404 to user: Instance d9e98590-5036-4ade-bbba-f743256ac961 could not be found. {{(pid=124670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:56:59.267735 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-4752bc99-972b-494b-a19a-cd8d39ab8967 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 404 len: 111 microversion: 2.20 time: 0.030204 Jun 23 11:56:59.267735 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 601/1192] 10.222.0.13 () {60 vars in 1279 bytes} [Thu Jun 23 11:56:59 2022] DELETE /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 23 11:56:59.271414 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-034f2852-0fb6-46f6-9599-bf23f2707c82 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:59.272033 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-034f2852-0fb6-46f6-9599-bf23f2707c82 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] [instance: d9e98590-5036-4ade-bbba-f743256ac961] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:59.278848 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-034f2852-0fb6-46f6-9599-bf23f2707c82 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:59.279297 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-034f2852-0fb6-46f6-9599-bf23f2707c82 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:59.280177 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-034f2852-0fb6-46f6-9599-bf23f2707c82 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:59.280625 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-034f2852-0fb6-46f6-9599-bf23f2707c82 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:59.293798 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.wsgi [None req-034f2852-0fb6-46f6-9599-bf23f2707c82 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] HTTP exception thrown: Instance d9e98590-5036-4ade-bbba-f743256ac961 could not be found. Jun 23 11:56:59.295337 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-034f2852-0fb6-46f6-9599-bf23f2707c82 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Request method failure captured: Jun 23 11:56:59.295337 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: request: GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 HTTP/1.1 Jun 23 11:56:59.295337 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Accept: application/json Jun 23 11:56:59.295337 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Accept-Encoding: identity Jun 23 11:56:59.295337 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Connection: close Jun 23 11:56:59.295337 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Content-Length: 0 Jun 23 11:56:59.295337 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Content-Type: application/json Jun 23 11:56:59.295337 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Host: 10.222.0.13 Jun 23 11:56:59.295337 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Openstack-System-Scope: None Jun 23 11:56:59.295337 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: User-Agent: python-urllib3/1.26.9 Jun 23 11:56:59.295337 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Auth-Token: gAAAAABitFKDO5UVobueQEQJ2YUHyncwckPaMgzyz_wvVEuptm8ae8DuBcodoQfFFPUmC1_B0Lg7tYFC0jL381L-1yVrhssvsKzevNvrbuMLiy9lOFiuw0Q1_NfG6KuVGkpedL76osllJXZ4E_neeeSEGUBNvd0Sh_8DFxFul8ZEUwsfBt9U_Hc Jun 23 11:56:59.295337 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Domain-Id: None Jun 23 11:56:59.295337 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Domain-Name: None Jun 23 11:56:59.295337 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Identity-Status: Confirmed Jun 23 11:56:59.295337 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Is-Admin-Project: True Jun 23 11:56:59.295337 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Openstack-Nova-Api-Version: 2.20 Jun 23 11:56:59.295337 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Domain-Id: default Jun 23 11:56:59.295337 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Domain-Name: Default Jun 23 11:56:59.295337 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Id: 4c0275f5304e4d9eae19c46a4f161217 Jun 23 11:56:59.295337 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1670293014 Jun 23 11:56:59.295337 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Role: member,reader Jun 23 11:56:59.295337 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Roles: member,reader Jun 23 11:56:59.297782 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4c0275f5304e4d9eae19c46a4f161217"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4c0275f5304e4d9eae19c46a4f161217"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4c0275f5304e4d9eae19c46a4f161217"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4c0275f5304e4d9eae19c46a4f161217"}]}] Jun 23 11:56:59.297782 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1670293014 Jun 23 11:56:59.297782 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant-Id: 4c0275f5304e4d9eae19c46a4f161217 Jun 23 11:56:59.297782 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1670293014 Jun 23 11:56:59.297782 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User: tempest-AttachVolumeShelveTestJSON-1670293014-project Jun 23 11:56:59.297782 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Domain-Id: default Jun 23 11:56:59.297782 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Domain-Name: Default Jun 23 11:56:59.297782 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Id: 41cb2b9a5156470aaeca9cc10f402ef9 Jun 23 11:56:59.297782 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1670293014-project Jun 23 11:56:59.297782 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: method: > Jun 23 11:56:59.297782 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: exception: Instance d9e98590-5036-4ade-bbba-f743256ac961 could not be found. Jun 23 11:56:59.297782 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: action_args: {'id': 'd9e98590-5036-4ade-bbba-f743256ac961'} Jun 23 11:56:59.298835 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:56:59.298835 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:56:59.298835 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:56:59.298835 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:56:59.298835 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:56:59.298835 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:56:59.298835 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:56:59.298835 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:56:59.298835 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:56:59.298835 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:56:59.298835 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9e98590-5036-4ade-bbba-f743256ac961 could not be found. Jun 23 11:56:59.298835 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:56:59.298835 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:56:59.298835 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:56:59.298835 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:56:59.298835 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:56:59.298835 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:56:59.298835 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:56:59.298835 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:56:59.298835 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:56:59.300352 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:56:59.300352 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 11:56:59.300352 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 11:56:59.300352 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:56:59.300352 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:56:59.300352 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:56:59.300352 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:56:59.300352 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9e98590-5036-4ade-bbba-f743256ac961 could not be found. Jun 23 11:56:59.300352 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:56:59.300352 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:56:59.300352 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:56:59.300352 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:56:59.300352 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:56:59.300352 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:56:59.300352 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:56:59.300352 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:56:59.300352 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9e98590-5036-4ade-bbba-f743256ac961 could not be found. Jun 23 11:56:59.300352 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:56:59.301810 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-034f2852-0fb6-46f6-9599-bf23f2707c82 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] Returning 404 to user: Instance d9e98590-5036-4ade-bbba-f743256ac961 could not be found. {{(pid=124669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:56:59.301810 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-034f2852-0fb6-46f6-9599-bf23f2707c82 tempest-AttachVolumeShelveTestJSON-1670293014 tempest-AttachVolumeShelveTestJSON-1670293014-project] 10.222.0.13 "GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961" status: 404 len: 111 microversion: 2.20 time: 0.030162 Jun 23 11:56:59.301810 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 592/1193] 10.222.0.13 () {60 vars in 1276 bytes} [Thu Jun 23 11:56:59 2022] GET /compute/v2.1/servers/d9e98590-5036-4ade-bbba-f743256ac961 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 23 11:57:07.586707 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-9c41e267-15ca-4c21-92a4-d7d6af4cea1d tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-160765872", "imageRef": "b19d6f23-214c-4432-bee6-455978023759", "flavorRef": "452", "networks": [{"uuid": "18d60617-bca0-4c91-9883-07435aa178bd"}]}} {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:57:07.650002 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.network.neutron [None req-9c41e267-15ca-4c21-92a4-d7d6af4cea1d tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] validate_networks() for [('18d60617-bca0-4c91-9883-07435aa178bd', None, None, None, None, None)] {{(pid=124670) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 11:57:08.078984 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.virt.hardware [None req-9c41e267-15ca-4c21-92a4-d7d6af4cea1d tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Flavor limits 0:0:0 {{(pid=124670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 11:57:08.082139 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.virt.hardware [None req-9c41e267-15ca-4c21-92a4-d7d6af4cea1d tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Image limits 0:0:0 {{(pid=124670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 11:57:08.082139 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.virt.hardware [None req-9c41e267-15ca-4c21-92a4-d7d6af4cea1d tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Flavor pref 0:0:0 {{(pid=124670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 11:57:08.082139 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.virt.hardware [None req-9c41e267-15ca-4c21-92a4-d7d6af4cea1d tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Image pref 0:0:0 {{(pid=124670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 11:57:08.082139 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.virt.hardware [None req-9c41e267-15ca-4c21-92a4-d7d6af4cea1d tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 11:57:08.092466 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-9c41e267-15ca-4c21-92a4-d7d6af4cea1d tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:08.095354 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-9c41e267-15ca-4c21-92a4-d7d6af4cea1d tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:08.096862 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-9c41e267-15ca-4c21-92a4-d7d6af4cea1d tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:08.097848 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-9c41e267-15ca-4c21-92a4-d7d6af4cea1d tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:08.106888 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:08.121811 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.quota [None req-9c41e267-15ca-4c21-92a4-d7d6af4cea1d tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Getting quotas for project a00e3dc3a73a42bdb9426b0213933056. Resources: {'cores', 'instances', 'ram'} {{(pid=124670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:57:08.126234 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.quota [None req-9c41e267-15ca-4c21-92a4-d7d6af4cea1d tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Getting quotas for user 69c345b278e4437d98f9b1f412bbca49 and project a00e3dc3a73a42bdb9426b0213933056. Resources: {'cores', 'instances', 'ram'} {{(pid=124670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:57:08.138106 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-9c41e267-15ca-4c21-92a4-d7d6af4cea1d tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Going to run 1 instances... {{(pid=124670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 11:57:08.140672 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-9c41e267-15ca-4c21-92a4-d7d6af4cea1d tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] [instance: 3288e091-983a-4d13-ab73-3328a85519f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b19d6f23-214c-4432-bee6-455978023759',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 11:57:08.352598 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-9c41e267-15ca-4c21-92a4-d7d6af4cea1d tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.769748 Jun 23 11:57:08.353283 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 602/1194] 10.222.0.13 () {60 vars in 1146 bytes} [Thu Jun 23 11:57:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 771 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 11:57:08.363474 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-e75b0822-54e4-4356-8e8d-5d38d5407bc1 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:08.364002 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-e75b0822-54e4-4356-8e8d-5d38d5407bc1 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] [instance: 3288e091-983a-4d13-ab73-3328a85519f1] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:08.435062 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-e75b0822-54e4-4356-8e8d-5d38d5407bc1 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c345b278e4437d98f9b1f412bbca49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00e3dc3a73a42bdb9426b0213933056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:08.442398 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-e75b0822-54e4-4356-8e8d-5d38d5407bc1 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] 10.222.0.13 "GET /compute/v2.1/servers/3288e091-983a-4d13-ab73-3328a85519f1" status: 200 len: 1213 microversion: 2.1 time: 0.082908 Jun 23 11:57:08.443356 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 593/1195] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:08 2022] GET /compute/v2.1/servers/3288e091-983a-4d13-ab73-3328a85519f1 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:09.459731 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-94a5ce81-f476-4a63-bf9d-7fa0de02db65 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:09.467191 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-94a5ce81-f476-4a63-bf9d-7fa0de02db65 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] [instance: 3288e091-983a-4d13-ab73-3328a85519f1] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:09.519386 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-94a5ce81-f476-4a63-bf9d-7fa0de02db65 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c345b278e4437d98f9b1f412bbca49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00e3dc3a73a42bdb9426b0213933056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:09.528144 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-94a5ce81-f476-4a63-bf9d-7fa0de02db65 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] 10.222.0.13 "GET /compute/v2.1/servers/3288e091-983a-4d13-ab73-3328a85519f1" status: 200 len: 1213 microversion: 2.1 time: 0.072314 Jun 23 11:57:09.528902 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 603/1196] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:09 2022] GET /compute/v2.1/servers/3288e091-983a-4d13-ab73-3328a85519f1 => generated 1213 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:10.545195 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-71ac09dc-1d91-46bd-9532-2c4a3a9164cf tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:10.545739 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-71ac09dc-1d91-46bd-9532-2c4a3a9164cf tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] [instance: 3288e091-983a-4d13-ab73-3328a85519f1] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:10.547988 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:10.554200 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-71ac09dc-1d91-46bd-9532-2c4a3a9164cf tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:10.554674 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-71ac09dc-1d91-46bd-9532-2c4a3a9164cf tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:10.555469 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-71ac09dc-1d91-46bd-9532-2c4a3a9164cf tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:10.555913 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-71ac09dc-1d91-46bd-9532-2c4a3a9164cf tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:10.616427 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-71ac09dc-1d91-46bd-9532-2c4a3a9164cf tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c345b278e4437d98f9b1f412bbca49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00e3dc3a73a42bdb9426b0213933056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:10.624031 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-71ac09dc-1d91-46bd-9532-2c4a3a9164cf tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] 10.222.0.13 "GET /compute/v2.1/servers/3288e091-983a-4d13-ab73-3328a85519f1" status: 200 len: 1265 microversion: 2.1 time: 0.082804 Jun 23 11:57:10.624617 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 594/1197] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:10 2022] GET /compute/v2.1/servers/3288e091-983a-4d13-ab73-3328a85519f1 => generated 1265 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:11.642634 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-e04d7e3d-2bc9-4093-a772-7b94c0ab6399 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:11.644068 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-e04d7e3d-2bc9-4093-a772-7b94c0ab6399 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] [instance: 3288e091-983a-4d13-ab73-3328a85519f1] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:11.652920 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-e04d7e3d-2bc9-4093-a772-7b94c0ab6399 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:11.653895 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-e04d7e3d-2bc9-4093-a772-7b94c0ab6399 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:11.654884 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-e04d7e3d-2bc9-4093-a772-7b94c0ab6399 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:11.655654 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-e04d7e3d-2bc9-4093-a772-7b94c0ab6399 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:11.739898 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-e04d7e3d-2bc9-4093-a772-7b94c0ab6399 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c345b278e4437d98f9b1f412bbca49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00e3dc3a73a42bdb9426b0213933056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:11.747850 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-e04d7e3d-2bc9-4093-a772-7b94c0ab6399 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] 10.222.0.13 "GET /compute/v2.1/servers/3288e091-983a-4d13-ab73-3328a85519f1" status: 200 len: 1271 microversion: 2.1 time: 0.110376 Jun 23 11:57:11.749857 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 604/1198] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:11 2022] GET /compute/v2.1/servers/3288e091-983a-4d13-ab73-3328a85519f1 => generated 1271 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:12.765603 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-7b336cd9-972d-48e8-94d8-f9927fdf6717 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:12.767501 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-7b336cd9-972d-48e8-94d8-f9927fdf6717 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] [instance: 3288e091-983a-4d13-ab73-3328a85519f1] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:12.775121 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-7b336cd9-972d-48e8-94d8-f9927fdf6717 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:12.775569 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-7b336cd9-972d-48e8-94d8-f9927fdf6717 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:12.776374 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-7b336cd9-972d-48e8-94d8-f9927fdf6717 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:12.776807 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-7b336cd9-972d-48e8-94d8-f9927fdf6717 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:12.967842 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-7b336cd9-972d-48e8-94d8-f9927fdf6717 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c345b278e4437d98f9b1f412bbca49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00e3dc3a73a42bdb9426b0213933056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:12.976372 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-7b336cd9-972d-48e8-94d8-f9927fdf6717 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] 10.222.0.13 "GET /compute/v2.1/servers/3288e091-983a-4d13-ab73-3328a85519f1" status: 200 len: 1313 microversion: 2.1 time: 0.214964 Jun 23 11:57:12.978166 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 595/1199] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:12 2022] GET /compute/v2.1/servers/3288e091-983a-4d13-ab73-3328a85519f1 => generated 1313 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:13.083707 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [req-334090a2-c554-4535-933e-4f500cfd6d04 req-f8672115-f861-44ae-be3a-516dc806d2d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3288e091-983a-4d13-ab73-3328a85519f1", "tag": "fff30944-1582-43d3-9fb8-e242c2986cbd"}]} {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:57:13.093287 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-334090a2-c554-4535-933e-4f500cfd6d04 req-f8672115-f861-44ae-be3a-516dc806d2d8 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:13.094601 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-334090a2-c554-4535-933e-4f500cfd6d04 req-f8672115-f861-44ae-be3a-516dc806d2d8 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:13.113472 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.compute.server_external_events [req-334090a2-c554-4535-933e-4f500cfd6d04 req-f8672115-f861-44ae-be3a-516dc806d2d8 service nova] Creating event network-changed:fff30944-1582-43d3-9fb8-e242c2986cbd for instance 3288e091-983a-4d13-ab73-3328a85519f1 on hv-cinder-82099 Jun 23 11:57:13.118433 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [req-334090a2-c554-4535-933e-4f500cfd6d04 req-f8672115-f861-44ae-be3a-516dc806d2d8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039993 Jun 23 11:57:13.119352 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 605/1200] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:57:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:57:13.993871 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-a29a3c12-91b0-4713-8c23-07d9936e3f4b tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:13.994623 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-a29a3c12-91b0-4713-8c23-07d9936e3f4b tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] [instance: 3288e091-983a-4d13-ab73-3328a85519f1] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:14.002510 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-a29a3c12-91b0-4713-8c23-07d9936e3f4b tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:14.003002 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-a29a3c12-91b0-4713-8c23-07d9936e3f4b tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:14.003755 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-a29a3c12-91b0-4713-8c23-07d9936e3f4b tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:14.004186 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-a29a3c12-91b0-4713-8c23-07d9936e3f4b tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:14.131326 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-a29a3c12-91b0-4713-8c23-07d9936e3f4b tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c345b278e4437d98f9b1f412bbca49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00e3dc3a73a42bdb9426b0213933056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:14.138597 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-a29a3c12-91b0-4713-8c23-07d9936e3f4b tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] 10.222.0.13 "GET /compute/v2.1/servers/3288e091-983a-4d13-ab73-3328a85519f1" status: 200 len: 1313 microversion: 2.1 time: 0.148993 Jun 23 11:57:14.139168 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 596/1201] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:13 2022] GET /compute/v2.1/servers/3288e091-983a-4d13-ab73-3328a85519f1 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:15.155622 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-c3b211a0-12e5-4740-9ab3-4bc1cb900de1 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:15.156258 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-c3b211a0-12e5-4740-9ab3-4bc1cb900de1 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] [instance: 3288e091-983a-4d13-ab73-3328a85519f1] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:15.163152 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-c3b211a0-12e5-4740-9ab3-4bc1cb900de1 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:15.163601 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-c3b211a0-12e5-4740-9ab3-4bc1cb900de1 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:15.164363 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-c3b211a0-12e5-4740-9ab3-4bc1cb900de1 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:15.164846 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-c3b211a0-12e5-4740-9ab3-4bc1cb900de1 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:15.302166 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-c3b211a0-12e5-4740-9ab3-4bc1cb900de1 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c345b278e4437d98f9b1f412bbca49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00e3dc3a73a42bdb9426b0213933056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:15.309952 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-c3b211a0-12e5-4740-9ab3-4bc1cb900de1 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] 10.222.0.13 "GET /compute/v2.1/servers/3288e091-983a-4d13-ab73-3328a85519f1" status: 200 len: 1313 microversion: 2.1 time: 0.158934 Jun 23 11:57:15.310642 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 606/1202] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:15 2022] GET /compute/v2.1/servers/3288e091-983a-4d13-ab73-3328a85519f1 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:16.327479 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-28a52669-bd27-4279-ae00-1881a6809020 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:16.328074 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-28a52669-bd27-4279-ae00-1881a6809020 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] [instance: 3288e091-983a-4d13-ab73-3328a85519f1] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:16.335030 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-28a52669-bd27-4279-ae00-1881a6809020 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:16.335479 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-28a52669-bd27-4279-ae00-1881a6809020 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:16.336238 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-28a52669-bd27-4279-ae00-1881a6809020 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:16.336674 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-28a52669-bd27-4279-ae00-1881a6809020 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:16.467157 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-28a52669-bd27-4279-ae00-1881a6809020 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c345b278e4437d98f9b1f412bbca49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00e3dc3a73a42bdb9426b0213933056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:16.475489 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-28a52669-bd27-4279-ae00-1881a6809020 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] 10.222.0.13 "GET /compute/v2.1/servers/3288e091-983a-4d13-ab73-3328a85519f1" status: 200 len: 1313 microversion: 2.1 time: 0.152233 Jun 23 11:57:16.476062 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 597/1203] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:16 2022] GET /compute/v2.1/servers/3288e091-983a-4d13-ab73-3328a85519f1 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:17.491879 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-5c73400b-42ec-4565-af50-d32fcba9d772 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:17.492489 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-5c73400b-42ec-4565-af50-d32fcba9d772 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] [instance: 3288e091-983a-4d13-ab73-3328a85519f1] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:17.498765 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-5c73400b-42ec-4565-af50-d32fcba9d772 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:17.499215 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-5c73400b-42ec-4565-af50-d32fcba9d772 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:17.499976 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-5c73400b-42ec-4565-af50-d32fcba9d772 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:17.500508 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-5c73400b-42ec-4565-af50-d32fcba9d772 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:17.639728 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-5c73400b-42ec-4565-af50-d32fcba9d772 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c345b278e4437d98f9b1f412bbca49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00e3dc3a73a42bdb9426b0213933056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:17.644060 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-5c73400b-42ec-4565-af50-d32fcba9d772 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] 10.222.0.13 "GET /compute/v2.1/servers/3288e091-983a-4d13-ab73-3328a85519f1" status: 200 len: 1313 microversion: 2.1 time: 0.156014 Jun 23 11:57:17.644643 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 607/1204] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:17 2022] GET /compute/v2.1/servers/3288e091-983a-4d13-ab73-3328a85519f1 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:18.660617 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-ad8e6ec9-dcb0-42db-b4ac-02dd5586e15d tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:18.661249 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-ad8e6ec9-dcb0-42db-b4ac-02dd5586e15d tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] [instance: 3288e091-983a-4d13-ab73-3328a85519f1] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:18.663621 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_cell0:SELECT=2 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:18.668874 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ad8e6ec9-dcb0-42db-b4ac-02dd5586e15d tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:18.669321 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ad8e6ec9-dcb0-42db-b4ac-02dd5586e15d tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:18.670067 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ad8e6ec9-dcb0-42db-b4ac-02dd5586e15d tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:18.670500 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ad8e6ec9-dcb0-42db-b4ac-02dd5586e15d tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:18.802486 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-ad8e6ec9-dcb0-42db-b4ac-02dd5586e15d tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c345b278e4437d98f9b1f412bbca49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00e3dc3a73a42bdb9426b0213933056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:18.810071 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-ad8e6ec9-dcb0-42db-b4ac-02dd5586e15d tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] 10.222.0.13 "GET /compute/v2.1/servers/3288e091-983a-4d13-ab73-3328a85519f1" status: 200 len: 1313 microversion: 2.1 time: 0.153348 Jun 23 11:57:18.810885 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 598/1205] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:18 2022] GET /compute/v2.1/servers/3288e091-983a-4d13-ab73-3328a85519f1 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:19.827685 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-129f8aa8-203b-48ff-95d5-549b5c16d16c tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:19.828302 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-129f8aa8-203b-48ff-95d5-549b5c16d16c tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] [instance: 3288e091-983a-4d13-ab73-3328a85519f1] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:19.830342 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_cell0:SELECT=2 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:19.831607 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_cell0:SELECT=8 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:19.846431 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-129f8aa8-203b-48ff-95d5-549b5c16d16c tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:19.847236 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-129f8aa8-203b-48ff-95d5-549b5c16d16c tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:19.849777 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-129f8aa8-203b-48ff-95d5-549b5c16d16c tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:19.849777 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-129f8aa8-203b-48ff-95d5-549b5c16d16c tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:19.993090 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-129f8aa8-203b-48ff-95d5-549b5c16d16c tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c345b278e4437d98f9b1f412bbca49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00e3dc3a73a42bdb9426b0213933056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:20.003580 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-129f8aa8-203b-48ff-95d5-549b5c16d16c tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] 10.222.0.13 "GET /compute/v2.1/servers/3288e091-983a-4d13-ab73-3328a85519f1" status: 200 len: 1313 microversion: 2.1 time: 0.179760 Jun 23 11:57:20.004153 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 608/1206] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:19 2022] GET /compute/v2.1/servers/3288e091-983a-4d13-ab73-3328a85519f1 => generated 1313 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:20.111056 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [req-72210a90-b7e6-4821-b037-bdf045e7945c req-1dc431f1-2555-4f9a-9fd8-9dbf022c8922 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3288e091-983a-4d13-ab73-3328a85519f1", "name": "network-vif-plugged", "status": "completed", "tag": "fff30944-1582-43d3-9fb8-e242c2986cbd"}]} {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:57:20.119587 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [req-72210a90-b7e6-4821-b037-bdf045e7945c req-1dc431f1-2555-4f9a-9fd8-9dbf022c8922 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:20.120018 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [req-72210a90-b7e6-4821-b037-bdf045e7945c req-1dc431f1-2555-4f9a-9fd8-9dbf022c8922 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:20.131090 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.compute.server_external_events [req-72210a90-b7e6-4821-b037-bdf045e7945c req-1dc431f1-2555-4f9a-9fd8-9dbf022c8922 service nova] Creating event network-vif-plugged:fff30944-1582-43d3-9fb8-e242c2986cbd for instance 3288e091-983a-4d13-ab73-3328a85519f1 on hv-cinder-82099 Jun 23 11:57:20.136413 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [req-72210a90-b7e6-4821-b037-bdf045e7945c req-1dc431f1-2555-4f9a-9fd8-9dbf022c8922 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.198749 Jun 23 11:57:20.137034 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 599/1207] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:57:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:57:21.021482 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-9ebf23ba-ba81-4c90-bfb4-66afd275d800 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:21.022094 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-9ebf23ba-ba81-4c90-bfb4-66afd275d800 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] [instance: 3288e091-983a-4d13-ab73-3328a85519f1] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:21.024866 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:21.030193 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-9ebf23ba-ba81-4c90-bfb4-66afd275d800 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:21.035368 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-9ebf23ba-ba81-4c90-bfb4-66afd275d800 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:21.035368 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-9ebf23ba-ba81-4c90-bfb4-66afd275d800 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:21.035368 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-9ebf23ba-ba81-4c90-bfb4-66afd275d800 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:21.173110 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-9ebf23ba-ba81-4c90-bfb4-66afd275d800 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c345b278e4437d98f9b1f412bbca49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00e3dc3a73a42bdb9426b0213933056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:21.181482 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-9ebf23ba-ba81-4c90-bfb4-66afd275d800 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] 10.222.0.13 "GET /compute/v2.1/servers/3288e091-983a-4d13-ab73-3328a85519f1" status: 200 len: 1313 microversion: 2.1 time: 0.164905 Jun 23 11:57:21.182262 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 609/1208] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:21 2022] GET /compute/v2.1/servers/3288e091-983a-4d13-ab73-3328a85519f1 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:22.199660 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-fdacc7e8-244e-4d48-b0dc-7271a24486f9 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:22.200394 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-fdacc7e8-244e-4d48-b0dc-7271a24486f9 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] [instance: 3288e091-983a-4d13-ab73-3328a85519f1] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:22.202455 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_api:SELECT=34,nova_api:DELETE=2 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:22.207817 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-fdacc7e8-244e-4d48-b0dc-7271a24486f9 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:22.208275 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-fdacc7e8-244e-4d48-b0dc-7271a24486f9 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:22.209041 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-fdacc7e8-244e-4d48-b0dc-7271a24486f9 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:22.209652 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-fdacc7e8-244e-4d48-b0dc-7271a24486f9 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:22.352713 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-fdacc7e8-244e-4d48-b0dc-7271a24486f9 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c345b278e4437d98f9b1f412bbca49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00e3dc3a73a42bdb9426b0213933056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:22.361481 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-fdacc7e8-244e-4d48-b0dc-7271a24486f9 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] 10.222.0.13 "GET /compute/v2.1/servers/3288e091-983a-4d13-ab73-3328a85519f1" status: 200 len: 1313 microversion: 2.1 time: 0.166339 Jun 23 11:57:22.362061 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 600/1209] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:22 2022] GET /compute/v2.1/servers/3288e091-983a-4d13-ab73-3328a85519f1 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:23.380702 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-84170352-86b0-4043-aeb8-af6206881096 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:23.381296 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-84170352-86b0-4043-aeb8-af6206881096 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] [instance: 3288e091-983a-4d13-ab73-3328a85519f1] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:23.387716 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-84170352-86b0-4043-aeb8-af6206881096 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:23.389037 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-84170352-86b0-4043-aeb8-af6206881096 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:23.389037 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-84170352-86b0-4043-aeb8-af6206881096 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:23.389936 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-84170352-86b0-4043-aeb8-af6206881096 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:23.529164 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-84170352-86b0-4043-aeb8-af6206881096 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c345b278e4437d98f9b1f412bbca49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00e3dc3a73a42bdb9426b0213933056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:23.536832 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-84170352-86b0-4043-aeb8-af6206881096 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] 10.222.0.13 "GET /compute/v2.1/servers/3288e091-983a-4d13-ab73-3328a85519f1" status: 200 len: 1497 microversion: 2.1 time: 0.161852 Jun 23 11:57:23.541043 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 610/1210] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:23 2022] GET /compute/v2.1/servers/3288e091-983a-4d13-ab73-3328a85519f1 => generated 1497 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:24.845093 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-f3ba2203-eacf-4742-9fb5-0b3c134abbc9 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:24.845805 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-f3ba2203-eacf-4742-9fb5-0b3c134abbc9 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] [instance: 3288e091-983a-4d13-ab73-3328a85519f1] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:24.852776 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-f3ba2203-eacf-4742-9fb5-0b3c134abbc9 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:24.853230 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-f3ba2203-eacf-4742-9fb5-0b3c134abbc9 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:24.854059 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-f3ba2203-eacf-4742-9fb5-0b3c134abbc9 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:24.854493 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-f3ba2203-eacf-4742-9fb5-0b3c134abbc9 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:24.882338 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-f3ba2203-eacf-4742-9fb5-0b3c134abbc9 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] [instance: 3288e091-983a-4d13-ab73-3328a85519f1] Going to try to terminate instance {{(pid=124669) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 11:57:25.242726 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-f3ba2203-eacf-4742-9fb5-0b3c134abbc9 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] 10.222.0.13 "DELETE /compute/v2.1/servers/3288e091-983a-4d13-ab73-3328a85519f1" status: 204 len: 0 microversion: 2.1 time: 0.401345 Jun 23 11:57:25.243466 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 601/1211] 10.222.0.13 () {58 vars in 1238 bytes} [Thu Jun 23 11:57:24 2022] DELETE /compute/v2.1/servers/3288e091-983a-4d13-ab73-3328a85519f1 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 11:57:25.257406 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-91040587-dbbc-4ec9-a9f1-cf4177511b88 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:25.258079 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-91040587-dbbc-4ec9-a9f1-cf4177511b88 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] [instance: 3288e091-983a-4d13-ab73-3328a85519f1] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:25.264814 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-91040587-dbbc-4ec9-a9f1-cf4177511b88 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:25.265264 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-91040587-dbbc-4ec9-a9f1-cf4177511b88 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:25.266025 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-91040587-dbbc-4ec9-a9f1-cf4177511b88 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:25.266490 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-91040587-dbbc-4ec9-a9f1-cf4177511b88 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:25.405742 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-91040587-dbbc-4ec9-a9f1-cf4177511b88 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c345b278e4437d98f9b1f412bbca49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00e3dc3a73a42bdb9426b0213933056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:25.414428 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-91040587-dbbc-4ec9-a9f1-cf4177511b88 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] 10.222.0.13 "GET /compute/v2.1/servers/3288e091-983a-4d13-ab73-3328a85519f1" status: 200 len: 1503 microversion: 2.1 time: 0.161032 Jun 23 11:57:25.415028 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 611/1212] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:25 2022] GET /compute/v2.1/servers/3288e091-983a-4d13-ab73-3328a85519f1 => generated 1503 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:26.432532 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-e063d3ec-e1c8-4269-a279-c88eda5f8088 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:26.433236 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-e063d3ec-e1c8-4269-a279-c88eda5f8088 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] [instance: 3288e091-983a-4d13-ab73-3328a85519f1] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:26.439855 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-e063d3ec-e1c8-4269-a279-c88eda5f8088 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:26.441171 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-e063d3ec-e1c8-4269-a279-c88eda5f8088 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:26.441703 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-e063d3ec-e1c8-4269-a279-c88eda5f8088 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:26.442069 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-e063d3ec-e1c8-4269-a279-c88eda5f8088 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:26.656887 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-e063d3ec-e1c8-4269-a279-c88eda5f8088 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c345b278e4437d98f9b1f412bbca49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00e3dc3a73a42bdb9426b0213933056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:26.665334 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-e063d3ec-e1c8-4269-a279-c88eda5f8088 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] 10.222.0.13 "GET /compute/v2.1/servers/3288e091-983a-4d13-ab73-3328a85519f1" status: 200 len: 1503 microversion: 2.1 time: 0.237021 Jun 23 11:57:26.665907 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 602/1213] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:26 2022] GET /compute/v2.1/servers/3288e091-983a-4d13-ab73-3328a85519f1 => generated 1503 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:27.329396 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [req-816c0427-4810-4f9c-8684-cfa455455263 req-a1c503cd-566a-4abf-a9d8-40321d33a488 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3288e091-983a-4d13-ab73-3328a85519f1", "name": "network-vif-deleted", "tag": "fff30944-1582-43d3-9fb8-e242c2986cbd"}]} {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:57:27.338876 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-816c0427-4810-4f9c-8684-cfa455455263 req-a1c503cd-566a-4abf-a9d8-40321d33a488 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:27.339327 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-816c0427-4810-4f9c-8684-cfa455455263 req-a1c503cd-566a-4abf-a9d8-40321d33a488 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:27.350415 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.compute.server_external_events [req-816c0427-4810-4f9c-8684-cfa455455263 req-a1c503cd-566a-4abf-a9d8-40321d33a488 service nova] Creating event network-vif-deleted:fff30944-1582-43d3-9fb8-e242c2986cbd for instance 3288e091-983a-4d13-ab73-3328a85519f1 on hv-cinder-82099 Jun 23 11:57:27.355558 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [req-816c0427-4810-4f9c-8684-cfa455455263 req-a1c503cd-566a-4abf-a9d8-40321d33a488 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029871 Jun 23 11:57:27.356146 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 612/1214] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:57:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:57:27.688054 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-23974d0e-2a27-4986-b887-4f6f3ca3bc21 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:27.688695 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-23974d0e-2a27-4986-b887-4f6f3ca3bc21 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] [instance: 3288e091-983a-4d13-ab73-3328a85519f1] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:27.696012 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-23974d0e-2a27-4986-b887-4f6f3ca3bc21 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:27.696465 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-23974d0e-2a27-4986-b887-4f6f3ca3bc21 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:27.697230 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-23974d0e-2a27-4986-b887-4f6f3ca3bc21 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:27.697712 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-23974d0e-2a27-4986-b887-4f6f3ca3bc21 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:27.729108 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-23974d0e-2a27-4986-b887-4f6f3ca3bc21 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:27.729558 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-23974d0e-2a27-4986-b887-4f6f3ca3bc21 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:27.730007 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.objects.instance [None req-23974d0e-2a27-4986-b887-4f6f3ca3bc21 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lazy-loading 'fault' on Instance uuid 3288e091-983a-4d13-ab73-3328a85519f1 {{(pid=124669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:57:27.797149 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-23974d0e-2a27-4986-b887-4f6f3ca3bc21 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c345b278e4437d98f9b1f412bbca49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00e3dc3a73a42bdb9426b0213933056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:27.816836 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-23974d0e-2a27-4986-b887-4f6f3ca3bc21 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] 10.222.0.13 "GET /compute/v2.1/servers/3288e091-983a-4d13-ab73-3328a85519f1" status: 200 len: 1303 microversion: 2.1 time: 0.132549 Jun 23 11:57:27.817703 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 603/1215] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:27 2022] GET /compute/v2.1/servers/3288e091-983a-4d13-ab73-3328a85519f1 => generated 1303 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:57:28.834927 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-9bf7e0bc-9962-4031-a962-3ebcd1a77c62 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:28.835627 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-9bf7e0bc-9962-4031-a962-3ebcd1a77c62 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] [instance: 3288e091-983a-4d13-ab73-3328a85519f1] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:28.842266 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-9bf7e0bc-9962-4031-a962-3ebcd1a77c62 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:28.842747 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-9bf7e0bc-9962-4031-a962-3ebcd1a77c62 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:28.843512 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-9bf7e0bc-9962-4031-a962-3ebcd1a77c62 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:28.844054 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-9bf7e0bc-9962-4031-a962-3ebcd1a77c62 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:28.857786 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.wsgi [None req-9bf7e0bc-9962-4031-a962-3ebcd1a77c62 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] HTTP exception thrown: Instance 3288e091-983a-4d13-ab73-3328a85519f1 could not be found. Jun 23 11:57:28.859479 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-9bf7e0bc-9962-4031-a962-3ebcd1a77c62 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Request method failure captured: Jun 23 11:57:28.859479 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: request: GET /compute/v2.1/servers/3288e091-983a-4d13-ab73-3328a85519f1 HTTP/1.1 Jun 23 11:57:28.859479 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Accept: application/json Jun 23 11:57:28.859479 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Accept-Encoding: identity Jun 23 11:57:28.859479 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Connection: close Jun 23 11:57:28.859479 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Content-Length: 0 Jun 23 11:57:28.859479 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Content-Type: application/json Jun 23 11:57:28.859479 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Host: 10.222.0.13 Jun 23 11:57:28.859479 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Openstack-System-Scope: None Jun 23 11:57:28.859479 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: User-Agent: python-urllib3/1.26.9 Jun 23 11:57:28.859479 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Auth-Token: gAAAAABitFURMW1qzTWGJno021Hpt-oOF5dBjIhAKQca_a7kkb2Mh37MoCX2gq4MY816m0tkx_PDFTRa8A13JLp3Dwi8QAS4BANmW_iBbN_B7yRORT3FVeBpOccESzMVHnu6AWU-AF-tm_bxfqerOi_sx60YUHfWnT05SGPlJn1fx-3RSQKCM4U Jun 23 11:57:28.859479 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Domain-Id: None Jun 23 11:57:28.859479 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Domain-Name: None Jun 23 11:57:28.859479 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Identity-Status: Confirmed Jun 23 11:57:28.859479 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Is-Admin-Project: True Jun 23 11:57:28.859479 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Domain-Id: default Jun 23 11:57:28.859479 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Domain-Name: Default Jun 23 11:57:28.859479 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Id: a00e3dc3a73a42bdb9426b0213933056 Jun 23 11:57:28.859479 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Name: tempest-VolumesActionsTest-290793612 Jun 23 11:57:28.859479 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Role: member,reader Jun 23 11:57:28.859479 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Roles: member,reader Jun 23 11:57:28.861242 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a00e3dc3a73a42bdb9426b0213933056"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a00e3dc3a73a42bdb9426b0213933056"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a00e3dc3a73a42bdb9426b0213933056"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a00e3dc3a73a42bdb9426b0213933056"}]}] Jun 23 11:57:28.861242 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Tenant: tempest-VolumesActionsTest-290793612 Jun 23 11:57:28.861242 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Tenant-Id: a00e3dc3a73a42bdb9426b0213933056 Jun 23 11:57:28.861242 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Tenant-Name: tempest-VolumesActionsTest-290793612 Jun 23 11:57:28.861242 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User: tempest-VolumesActionsTest-290793612-project Jun 23 11:57:28.861242 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Domain-Id: default Jun 23 11:57:28.861242 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Domain-Name: Default Jun 23 11:57:28.861242 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Id: 69c345b278e4437d98f9b1f412bbca49 Jun 23 11:57:28.861242 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Name: tempest-VolumesActionsTest-290793612-project Jun 23 11:57:28.861242 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: method: > Jun 23 11:57:28.861242 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: exception: Instance 3288e091-983a-4d13-ab73-3328a85519f1 could not be found. Jun 23 11:57:28.861242 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: action_args: {'id': '3288e091-983a-4d13-ab73-3328a85519f1'} Jun 23 11:57:28.862242 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:57:28.862242 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:57:28.862242 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:57:28.862242 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:57:28.862242 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:57:28.862242 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:57:28.862242 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:57:28.862242 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:57:28.862242 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:57:28.862242 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:57:28.862242 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3288e091-983a-4d13-ab73-3328a85519f1 could not be found. Jun 23 11:57:28.862242 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:57:28.862242 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:57:28.862242 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:57:28.862242 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:57:28.862242 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:57:28.862242 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:57:28.862242 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:57:28.862242 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:57:28.862242 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:57:28.864461 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:57:28.864461 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 11:57:28.864461 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 11:57:28.864461 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:57:28.864461 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:57:28.864461 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:57:28.864461 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:57:28.864461 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3288e091-983a-4d13-ab73-3328a85519f1 could not be found. Jun 23 11:57:28.864461 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:57:28.864461 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:57:28.864461 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:57:28.864461 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:57:28.864461 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:57:28.864461 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:57:28.864461 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:57:28.864461 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:57:28.864461 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3288e091-983a-4d13-ab73-3328a85519f1 could not be found. Jun 23 11:57:28.864461 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:57:28.865872 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-9bf7e0bc-9962-4031-a962-3ebcd1a77c62 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Returning 404 to user: Instance 3288e091-983a-4d13-ab73-3328a85519f1 could not be found. {{(pid=124670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:57:28.865872 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-9bf7e0bc-9962-4031-a962-3ebcd1a77c62 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] 10.222.0.13 "GET /compute/v2.1/servers/3288e091-983a-4d13-ab73-3328a85519f1" status: 404 len: 111 microversion: 2.1 time: 0.031046 Jun 23 11:57:28.865872 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 613/1216] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:28 2022] GET /compute/v2.1/servers/3288e091-983a-4d13-ab73-3328a85519f1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:57:28.960584 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-3bc087c4-60de-4421-9190-754f418df7af tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1903846121", "imageRef": "b19d6f23-214c-4432-bee6-455978023759", "flavorRef": "452", "networks": [{"uuid": "18d60617-bca0-4c91-9883-07435aa178bd"}]}} {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:57:29.025291 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.network.neutron [None req-3bc087c4-60de-4421-9190-754f418df7af tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] validate_networks() for [('18d60617-bca0-4c91-9883-07435aa178bd', None, None, None, None, None)] {{(pid=124669) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 11:57:29.502291 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.virt.hardware [None req-3bc087c4-60de-4421-9190-754f418df7af tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Flavor limits 0:0:0 {{(pid=124669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 11:57:29.502729 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.virt.hardware [None req-3bc087c4-60de-4421-9190-754f418df7af tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Image limits 0:0:0 {{(pid=124669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 11:57:29.504417 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.virt.hardware [None req-3bc087c4-60de-4421-9190-754f418df7af tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Flavor pref 0:0:0 {{(pid=124669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 11:57:29.504831 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.virt.hardware [None req-3bc087c4-60de-4421-9190-754f418df7af tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Image pref 0:0:0 {{(pid=124669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 11:57:29.505245 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.virt.hardware [None req-3bc087c4-60de-4421-9190-754f418df7af tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124669) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 11:57:29.513913 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-3bc087c4-60de-4421-9190-754f418df7af tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:29.514352 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-3bc087c4-60de-4421-9190-754f418df7af tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:29.515165 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-3bc087c4-60de-4421-9190-754f418df7af tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:29.515592 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-3bc087c4-60de-4421-9190-754f418df7af tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:29.532111 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.quota [None req-3bc087c4-60de-4421-9190-754f418df7af tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Getting quotas for project a00e3dc3a73a42bdb9426b0213933056. Resources: {'cores', 'instances', 'ram'} {{(pid=124669) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:57:29.536862 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.quota [None req-3bc087c4-60de-4421-9190-754f418df7af tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Getting quotas for user 69c345b278e4437d98f9b1f412bbca49 and project a00e3dc3a73a42bdb9426b0213933056. Resources: {'cores', 'instances', 'ram'} {{(pid=124669) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:57:29.547595 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-3bc087c4-60de-4421-9190-754f418df7af tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Going to run 1 instances... {{(pid=124669) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 11:57:29.549837 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-3bc087c4-60de-4421-9190-754f418df7af tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] [instance: 31729dc9-9c30-4111-a6a2-2e308abb7b00] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b19d6f23-214c-4432-bee6-455978023759',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124669) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 11:57:29.665704 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-3bc087c4-60de-4421-9190-754f418df7af tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.707871 Jun 23 11:57:29.665704 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 604/1217] 10.222.0.13 () {60 vars in 1146 bytes} [Thu Jun 23 11:57:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 710 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 11:57:29.674619 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-8090aacf-4657-4230-9b20-9ab64fdc763d tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:29.678984 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-8090aacf-4657-4230-9b20-9ab64fdc763d tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] [instance: 31729dc9-9c30-4111-a6a2-2e308abb7b00] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:29.749387 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-8090aacf-4657-4230-9b20-9ab64fdc763d tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c345b278e4437d98f9b1f412bbca49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00e3dc3a73a42bdb9426b0213933056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:29.757013 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-8090aacf-4657-4230-9b20-9ab64fdc763d tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] 10.222.0.13 "GET /compute/v2.1/servers/31729dc9-9c30-4111-a6a2-2e308abb7b00" status: 200 len: 1214 microversion: 2.1 time: 0.086191 Jun 23 11:57:29.757600 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 614/1218] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:29 2022] GET /compute/v2.1/servers/31729dc9-9c30-4111-a6a2-2e308abb7b00 => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:30.775231 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-d2a18a24-74e0-4816-9017-451ddb48c262 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:30.777305 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-d2a18a24-74e0-4816-9017-451ddb48c262 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] [instance: 31729dc9-9c30-4111-a6a2-2e308abb7b00] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:30.839576 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-d2a18a24-74e0-4816-9017-451ddb48c262 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c345b278e4437d98f9b1f412bbca49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00e3dc3a73a42bdb9426b0213933056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:30.847058 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-d2a18a24-74e0-4816-9017-451ddb48c262 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] 10.222.0.13 "GET /compute/v2.1/servers/31729dc9-9c30-4111-a6a2-2e308abb7b00" status: 200 len: 1214 microversion: 2.1 time: 0.076884 Jun 23 11:57:30.847755 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 605/1219] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:30 2022] GET /compute/v2.1/servers/31729dc9-9c30-4111-a6a2-2e308abb7b00 => generated 1214 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:30.855129 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 11:57:30.855637 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Thu Jun 23 11:57:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 11:57:31.864197 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-e9b7812b-ca40-475c-bc38-cf7b9054498d tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:31.865505 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-e9b7812b-ca40-475c-bc38-cf7b9054498d tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] [instance: 31729dc9-9c30-4111-a6a2-2e308abb7b00] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:31.941502 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-e9b7812b-ca40-475c-bc38-cf7b9054498d tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c345b278e4437d98f9b1f412bbca49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00e3dc3a73a42bdb9426b0213933056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:31.948182 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-e9b7812b-ca40-475c-bc38-cf7b9054498d tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] 10.222.0.13 "GET /compute/v2.1/servers/31729dc9-9c30-4111-a6a2-2e308abb7b00" status: 200 len: 1214 microversion: 2.1 time: 0.088613 Jun 23 11:57:31.948744 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 615/1220] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:31 2022] GET /compute/v2.1/servers/31729dc9-9c30-4111-a6a2-2e308abb7b00 => generated 1214 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:32.965216 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-d1a98c2b-3bca-4ff4-ad03-942b08c2b854 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:32.965821 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-d1a98c2b-3bca-4ff4-ad03-942b08c2b854 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] [instance: 31729dc9-9c30-4111-a6a2-2e308abb7b00] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:33.028330 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-d1a98c2b-3bca-4ff4-ad03-942b08c2b854 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c345b278e4437d98f9b1f412bbca49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00e3dc3a73a42bdb9426b0213933056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:33.036939 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-d1a98c2b-3bca-4ff4-ad03-942b08c2b854 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] 10.222.0.13 "GET /compute/v2.1/servers/31729dc9-9c30-4111-a6a2-2e308abb7b00" status: 200 len: 1214 microversion: 2.1 time: 0.075411 Jun 23 11:57:33.037516 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 606/1221] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:32 2022] GET /compute/v2.1/servers/31729dc9-9c30-4111-a6a2-2e308abb7b00 => generated 1214 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:34.053317 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-2a92a31f-abf0-4a7b-85a6-1459803a16f8 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:34.053904 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-2a92a31f-abf0-4a7b-85a6-1459803a16f8 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] [instance: 31729dc9-9c30-4111-a6a2-2e308abb7b00] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:34.060382 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-2a92a31f-abf0-4a7b-85a6-1459803a16f8 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:34.060832 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-2a92a31f-abf0-4a7b-85a6-1459803a16f8 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:34.061592 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-2a92a31f-abf0-4a7b-85a6-1459803a16f8 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:34.062027 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-2a92a31f-abf0-4a7b-85a6-1459803a16f8 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:34.124109 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-2a92a31f-abf0-4a7b-85a6-1459803a16f8 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c345b278e4437d98f9b1f412bbca49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00e3dc3a73a42bdb9426b0213933056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:34.133213 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-2a92a31f-abf0-4a7b-85a6-1459803a16f8 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] 10.222.0.13 "GET /compute/v2.1/servers/31729dc9-9c30-4111-a6a2-2e308abb7b00" status: 200 len: 1218 microversion: 2.1 time: 0.083960 Jun 23 11:57:34.133787 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 616/1222] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:34 2022] GET /compute/v2.1/servers/31729dc9-9c30-4111-a6a2-2e308abb7b00 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:35.150211 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-419848d2-a0c5-46b7-b7c4-05fa5c0020b7 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:35.150865 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-419848d2-a0c5-46b7-b7c4-05fa5c0020b7 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] [instance: 31729dc9-9c30-4111-a6a2-2e308abb7b00] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:35.157449 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-419848d2-a0c5-46b7-b7c4-05fa5c0020b7 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:35.157901 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-419848d2-a0c5-46b7-b7c4-05fa5c0020b7 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:35.158690 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-419848d2-a0c5-46b7-b7c4-05fa5c0020b7 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:35.159125 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-419848d2-a0c5-46b7-b7c4-05fa5c0020b7 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:35.234434 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-419848d2-a0c5-46b7-b7c4-05fa5c0020b7 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c345b278e4437d98f9b1f412bbca49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00e3dc3a73a42bdb9426b0213933056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:35.242690 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-419848d2-a0c5-46b7-b7c4-05fa5c0020b7 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] 10.222.0.13 "GET /compute/v2.1/servers/31729dc9-9c30-4111-a6a2-2e308abb7b00" status: 200 len: 1218 microversion: 2.1 time: 0.096213 Jun 23 11:57:35.243335 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 607/1223] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:35 2022] GET /compute/v2.1/servers/31729dc9-9c30-4111-a6a2-2e308abb7b00 => generated 1218 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:36.260269 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-a23ad259-ad38-4c12-a196-df0ca78f2e74 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:36.261021 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-a23ad259-ad38-4c12-a196-df0ca78f2e74 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] [instance: 31729dc9-9c30-4111-a6a2-2e308abb7b00] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:36.267354 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a23ad259-ad38-4c12-a196-df0ca78f2e74 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:36.267806 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a23ad259-ad38-4c12-a196-df0ca78f2e74 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:36.268866 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a23ad259-ad38-4c12-a196-df0ca78f2e74 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:36.269022 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a23ad259-ad38-4c12-a196-df0ca78f2e74 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:36.341063 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-a23ad259-ad38-4c12-a196-df0ca78f2e74 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c345b278e4437d98f9b1f412bbca49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00e3dc3a73a42bdb9426b0213933056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:36.350792 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-a23ad259-ad38-4c12-a196-df0ca78f2e74 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] 10.222.0.13 "GET /compute/v2.1/servers/31729dc9-9c30-4111-a6a2-2e308abb7b00" status: 200 len: 1266 microversion: 2.1 time: 0.094244 Jun 23 11:57:36.351400 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 617/1224] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:36 2022] GET /compute/v2.1/servers/31729dc9-9c30-4111-a6a2-2e308abb7b00 => generated 1266 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:36.724859 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-51972659-b468-460d-bd9b-722fbb88e26b tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1170916986"}} {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:57:36.725442 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-51972659-b468-460d-bd9b-722fbb88e26b tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] [instance: 06c1d69d-fafe-412e-ac84-49c12c6029d0] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:36.732424 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-51972659-b468-460d-bd9b-722fbb88e26b tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:36.733211 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-51972659-b468-460d-bd9b-722fbb88e26b tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:36.733964 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-51972659-b468-460d-bd9b-722fbb88e26b tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:36.734400 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-51972659-b468-460d-bd9b-722fbb88e26b tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:36.939537 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.network.security_group_api [None req-51972659-b468-460d-bd9b-722fbb88e26b tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Removing security group 06864c33-c25d-44f1-b654-eec1052dc21d from port 2f36a3ef-b1bd-48d9-8060-f3cbb922568c Jun 23 11:57:37.368435 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-33ddca3a-0615-423b-8abf-1a94986cba3f tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:37.369593 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-33ddca3a-0615-423b-8abf-1a94986cba3f tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] [instance: 31729dc9-9c30-4111-a6a2-2e308abb7b00] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:37.376926 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-33ddca3a-0615-423b-8abf-1a94986cba3f tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:37.377372 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-33ddca3a-0615-423b-8abf-1a94986cba3f tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:37.378145 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-33ddca3a-0615-423b-8abf-1a94986cba3f tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:37.378599 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-33ddca3a-0615-423b-8abf-1a94986cba3f tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:37.464147 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-33ddca3a-0615-423b-8abf-1a94986cba3f tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c345b278e4437d98f9b1f412bbca49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00e3dc3a73a42bdb9426b0213933056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:37.471810 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-33ddca3a-0615-423b-8abf-1a94986cba3f tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] 10.222.0.13 "GET /compute/v2.1/servers/31729dc9-9c30-4111-a6a2-2e308abb7b00" status: 200 len: 1272 microversion: 2.1 time: 0.107834 Jun 23 11:57:37.482696 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 618/1225] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:37 2022] GET /compute/v2.1/servers/31729dc9-9c30-4111-a6a2-2e308abb7b00 => generated 1272 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:57:37.812290 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-51972659-b468-460d-bd9b-722fbb88e26b tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] 10.222.0.13 "POST /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0/action" status: 202 len: 0 microversion: 2.1 time: 1.092271 Jun 23 11:57:37.813548 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 608/1226] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Jun 23 11:57:36 2022] POST /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0/action => generated 0 bytes in 1094 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 11:57:37.828267 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [req-731bd890-dff1-45f9-93bf-d4acc2ff4b18 req-3f7c50a7-b08d-4546-ac80-5972bd2d0730 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06c1d69d-fafe-412e-ac84-49c12c6029d0", "tag": "2f36a3ef-b1bd-48d9-8060-f3cbb922568c"}]} {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:57:37.839123 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-731bd890-dff1-45f9-93bf-d4acc2ff4b18 req-3f7c50a7-b08d-4546-ac80-5972bd2d0730 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:37.840201 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-731bd890-dff1-45f9-93bf-d4acc2ff4b18 req-3f7c50a7-b08d-4546-ac80-5972bd2d0730 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:37.857260 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.compute.server_external_events [req-731bd890-dff1-45f9-93bf-d4acc2ff4b18 req-3f7c50a7-b08d-4546-ac80-5972bd2d0730 service nova] Creating event network-changed:2f36a3ef-b1bd-48d9-8060-f3cbb922568c for instance 06c1d69d-fafe-412e-ac84-49c12c6029d0 on hv-cinder-82099 Jun 23 11:57:37.864856 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [req-731bd890-dff1-45f9-93bf-d4acc2ff4b18 req-3f7c50a7-b08d-4546-ac80-5972bd2d0730 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041265 Jun 23 11:57:37.866453 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 619/1227] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:57:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:57:38.492076 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-f076a231-9bc3-4763-b19a-9de1ac272791 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:38.493056 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-f076a231-9bc3-4763-b19a-9de1ac272791 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] [instance: 31729dc9-9c30-4111-a6a2-2e308abb7b00] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:38.501403 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-f076a231-9bc3-4763-b19a-9de1ac272791 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:38.501868 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-f076a231-9bc3-4763-b19a-9de1ac272791 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:38.503417 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-f076a231-9bc3-4763-b19a-9de1ac272791 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:38.503907 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-f076a231-9bc3-4763-b19a-9de1ac272791 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:38.865507 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-f076a231-9bc3-4763-b19a-9de1ac272791 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c345b278e4437d98f9b1f412bbca49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00e3dc3a73a42bdb9426b0213933056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:38.872921 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-f076a231-9bc3-4763-b19a-9de1ac272791 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] 10.222.0.13 "GET /compute/v2.1/servers/31729dc9-9c30-4111-a6a2-2e308abb7b00" status: 200 len: 1314 microversion: 2.1 time: 0.385327 Jun 23 11:57:38.873485 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 609/1228] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:38 2022] GET /compute/v2.1/servers/31729dc9-9c30-4111-a6a2-2e308abb7b00 => generated 1314 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:39.891522 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [req-e94ca3de-9d02-44f7-b6d9-c0e6965187be req-fd2c05b6-3977-4c90-afc3-34d8d50d311e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31729dc9-9c30-4111-a6a2-2e308abb7b00", "tag": "f1955fb4-9730-4dd6-a52a-558f2df5f64a"}]} {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:57:39.897540 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-3d2c5886-108b-45ea-9380-9748ab0b8666 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:39.904080 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-3d2c5886-108b-45ea-9380-9748ab0b8666 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] [instance: 31729dc9-9c30-4111-a6a2-2e308abb7b00] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:39.908277 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_cell0:SELECT=2 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:39.914314 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-e94ca3de-9d02-44f7-b6d9-c0e6965187be req-fd2c05b6-3977-4c90-afc3-34d8d50d311e service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:39.915776 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-3d2c5886-108b-45ea-9380-9748ab0b8666 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:39.916226 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-3d2c5886-108b-45ea-9380-9748ab0b8666 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:39.917069 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-3d2c5886-108b-45ea-9380-9748ab0b8666 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:39.917566 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-e94ca3de-9d02-44f7-b6d9-c0e6965187be req-fd2c05b6-3977-4c90-afc3-34d8d50d311e service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:39.920689 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-3d2c5886-108b-45ea-9380-9748ab0b8666 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:39.948645 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.compute.server_external_events [req-e94ca3de-9d02-44f7-b6d9-c0e6965187be req-fd2c05b6-3977-4c90-afc3-34d8d50d311e service nova] Creating event network-changed:f1955fb4-9730-4dd6-a52a-558f2df5f64a for instance 31729dc9-9c30-4111-a6a2-2e308abb7b00 on hv-cinder-82099 Jun 23 11:57:39.954298 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [req-e94ca3de-9d02-44f7-b6d9-c0e6965187be req-fd2c05b6-3977-4c90-afc3-34d8d50d311e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067304 Jun 23 11:57:39.958829 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 620/1229] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:57:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:57:39.968664 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-fe3118f3-34de-4cdb-8278-f8565ff6a9b4 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:39.969451 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-fe3118f3-34de-4cdb-8278-f8565ff6a9b4 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] [instance: 06c1d69d-fafe-412e-ac84-49c12c6029d0] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:39.985539 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-fe3118f3-34de-4cdb-8278-f8565ff6a9b4 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:39.986186 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-fe3118f3-34de-4cdb-8278-f8565ff6a9b4 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:39.989866 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-fe3118f3-34de-4cdb-8278-f8565ff6a9b4 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:39.989866 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-fe3118f3-34de-4cdb-8278-f8565ff6a9b4 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:40.090992 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.objects.instance [None req-fe3118f3-34de-4cdb-8278-f8565ff6a9b4 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lazy-loading 'services' on Instance uuid 06c1d69d-fafe-412e-ac84-49c12c6029d0 {{(pid=124670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:57:40.115408 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-3d2c5886-108b-45ea-9380-9748ab0b8666 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c345b278e4437d98f9b1f412bbca49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00e3dc3a73a42bdb9426b0213933056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:40.124371 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-3d2c5886-108b-45ea-9380-9748ab0b8666 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] 10.222.0.13 "GET /compute/v2.1/servers/31729dc9-9c30-4111-a6a2-2e308abb7b00" status: 200 len: 1314 microversion: 2.1 time: 0.231071 Jun 23 11:57:40.125047 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 610/1230] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:39 2022] GET /compute/v2.1/servers/31729dc9-9c30-4111-a6a2-2e308abb7b00 => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:40.391231 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-fe3118f3-34de-4cdb-8278-f8565ff6a9b4 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] 10.222.0.13 "DELETE /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0/os-volume_attachments/29ecd8ea-6be5-4ff0-8be1-c2b2e3ebd7c0" status: 202 len: 0 microversion: 2.1 time: 0.430667 Jun 23 11:57:40.391993 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 621/1231] 10.222.0.13 () {58 vars in 1415 bytes} [Thu Jun 23 11:57:39 2022] DELETE /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0/os-volume_attachments/29ecd8ea-6be5-4ff0-8be1-c2b2e3ebd7c0 => generated 0 bytes in 432 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 11:57:40.405883 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-21950dae-ffe1-4351-a677-a2ea233184f5 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:40.405883 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-21950dae-ffe1-4351-a677-a2ea233184f5 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] [instance: 06c1d69d-fafe-412e-ac84-49c12c6029d0] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:40.408570 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-21950dae-ffe1-4351-a677-a2ea233184f5 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:40.409228 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-21950dae-ffe1-4351-a677-a2ea233184f5 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:40.410066 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-21950dae-ffe1-4351-a677-a2ea233184f5 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:40.410699 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-21950dae-ffe1-4351-a677-a2ea233184f5 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:40.444912 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-21950dae-ffe1-4351-a677-a2ea233184f5 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] 10.222.0.13 "GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047824 Jun 23 11:57:40.445865 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 611/1232] 10.222.0.13 () {58 vars in 1301 bytes} [Thu Jun 23 11:57:40 2022] GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:57:41.145064 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-368a2af4-0cd1-49a6-b723-9fe80a786007 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:41.146616 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-368a2af4-0cd1-49a6-b723-9fe80a786007 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] [instance: 31729dc9-9c30-4111-a6a2-2e308abb7b00] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:41.153159 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-368a2af4-0cd1-49a6-b723-9fe80a786007 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:41.157805 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-368a2af4-0cd1-49a6-b723-9fe80a786007 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:41.157805 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-368a2af4-0cd1-49a6-b723-9fe80a786007 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:41.157805 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-368a2af4-0cd1-49a6-b723-9fe80a786007 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:41.298651 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-368a2af4-0cd1-49a6-b723-9fe80a786007 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c345b278e4437d98f9b1f412bbca49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00e3dc3a73a42bdb9426b0213933056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:41.307670 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-368a2af4-0cd1-49a6-b723-9fe80a786007 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] 10.222.0.13 "GET /compute/v2.1/servers/31729dc9-9c30-4111-a6a2-2e308abb7b00" status: 200 len: 1314 microversion: 2.1 time: 0.169523 Jun 23 11:57:41.308323 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 622/1233] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:41 2022] GET /compute/v2.1/servers/31729dc9-9c30-4111-a6a2-2e308abb7b00 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:41.457896 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-ac08c362-b699-4d15-97e2-ef77f217d0ca tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:41.458563 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-ac08c362-b699-4d15-97e2-ef77f217d0ca tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] [instance: 06c1d69d-fafe-412e-ac84-49c12c6029d0] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:41.465920 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ac08c362-b699-4d15-97e2-ef77f217d0ca tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:41.466422 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ac08c362-b699-4d15-97e2-ef77f217d0ca tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:41.467218 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ac08c362-b699-4d15-97e2-ef77f217d0ca tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:41.467662 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-ac08c362-b699-4d15-97e2-ef77f217d0ca tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:41.471531 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:41.502439 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-ac08c362-b699-4d15-97e2-ef77f217d0ca tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] 10.222.0.13 "GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046972 Jun 23 11:57:41.502439 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 612/1234] 10.222.0.13 () {58 vars in 1301 bytes} [Thu Jun 23 11:57:41 2022] GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:57:41.977335 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [req-d49b3518-9edb-4f6e-b972-ab5e9b83d53b req-d0ae2eb2-d755-4973-aa7c-cfeaa2e67844 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06c1d69d-fafe-412e-ac84-49c12c6029d0", "tag": "2f36a3ef-b1bd-48d9-8060-f3cbb922568c"}]} {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:57:41.981107 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_cell0:SELECT=4 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:41.986911 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-d49b3518-9edb-4f6e-b972-ab5e9b83d53b req-d0ae2eb2-d755-4973-aa7c-cfeaa2e67844 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:41.987398 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-d49b3518-9edb-4f6e-b972-ab5e9b83d53b req-d0ae2eb2-d755-4973-aa7c-cfeaa2e67844 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:41.991742 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=1 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:41.999020 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.compute.server_external_events [req-d49b3518-9edb-4f6e-b972-ab5e9b83d53b req-d0ae2eb2-d755-4973-aa7c-cfeaa2e67844 service nova] Creating event network-changed:2f36a3ef-b1bd-48d9-8060-f3cbb922568c for instance 06c1d69d-fafe-412e-ac84-49c12c6029d0 on hv-cinder-82099 Jun 23 11:57:42.005065 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [req-d49b3518-9edb-4f6e-b972-ab5e9b83d53b req-d0ae2eb2-d755-4973-aa7c-cfeaa2e67844 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031829 Jun 23 11:57:42.005873 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 623/1235] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:57:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:57:42.326601 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-e63fed50-02eb-4fc3-b75e-26a4cbb11eb4 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:42.327577 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-e63fed50-02eb-4fc3-b75e-26a4cbb11eb4 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] [instance: 31729dc9-9c30-4111-a6a2-2e308abb7b00] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:42.337592 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-e63fed50-02eb-4fc3-b75e-26a4cbb11eb4 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:42.338612 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-e63fed50-02eb-4fc3-b75e-26a4cbb11eb4 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:42.339490 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-e63fed50-02eb-4fc3-b75e-26a4cbb11eb4 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:42.339991 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-e63fed50-02eb-4fc3-b75e-26a4cbb11eb4 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:42.501864 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-e63fed50-02eb-4fc3-b75e-26a4cbb11eb4 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c345b278e4437d98f9b1f412bbca49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00e3dc3a73a42bdb9426b0213933056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:42.509739 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-e63fed50-02eb-4fc3-b75e-26a4cbb11eb4 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] 10.222.0.13 "GET /compute/v2.1/servers/31729dc9-9c30-4111-a6a2-2e308abb7b00" status: 200 len: 1314 microversion: 2.1 time: 0.187564 Jun 23 11:57:42.510310 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 613/1236] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:42 2022] GET /compute/v2.1/servers/31729dc9-9c30-4111-a6a2-2e308abb7b00 => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:42.513238 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-6462ce7a-98cc-4456-a977-57458699d6bb tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:42.514262 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-6462ce7a-98cc-4456-a977-57458699d6bb tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] [instance: 06c1d69d-fafe-412e-ac84-49c12c6029d0] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:42.522560 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-6462ce7a-98cc-4456-a977-57458699d6bb tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:42.522945 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-6462ce7a-98cc-4456-a977-57458699d6bb tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:42.523703 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-6462ce7a-98cc-4456-a977-57458699d6bb tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:42.524136 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-6462ce7a-98cc-4456-a977-57458699d6bb tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:42.556010 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-6462ce7a-98cc-4456-a977-57458699d6bb tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] 10.222.0.13 "GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047020 Jun 23 11:57:42.556573 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 624/1237] 10.222.0.13 () {58 vars in 1301 bytes} [Thu Jun 23 11:57:42 2022] GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:57:43.526679 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-7cba221c-dd7a-4815-a9a8-ba472f1b1618 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:43.527272 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-7cba221c-dd7a-4815-a9a8-ba472f1b1618 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] [instance: 31729dc9-9c30-4111-a6a2-2e308abb7b00] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:43.529153 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_cell0:SELECT=10 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:43.534943 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-7cba221c-dd7a-4815-a9a8-ba472f1b1618 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:43.535461 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-7cba221c-dd7a-4815-a9a8-ba472f1b1618 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:43.536424 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-7cba221c-dd7a-4815-a9a8-ba472f1b1618 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:43.536926 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-7cba221c-dd7a-4815-a9a8-ba472f1b1618 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:43.568165 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-36b45180-2a4b-4bc7-bc86-86e5f40c9bd8 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:43.569084 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-36b45180-2a4b-4bc7-bc86-86e5f40c9bd8 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] [instance: 06c1d69d-fafe-412e-ac84-49c12c6029d0] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:43.575989 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-36b45180-2a4b-4bc7-bc86-86e5f40c9bd8 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:43.576436 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-36b45180-2a4b-4bc7-bc86-86e5f40c9bd8 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:43.577191 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-36b45180-2a4b-4bc7-bc86-86e5f40c9bd8 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:43.577720 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-36b45180-2a4b-4bc7-bc86-86e5f40c9bd8 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:43.607652 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-36b45180-2a4b-4bc7-bc86-86e5f40c9bd8 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] 10.222.0.13 "GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043938 Jun 23 11:57:43.608209 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 625/1238] 10.222.0.13 () {58 vars in 1301 bytes} [Thu Jun 23 11:57:43 2022] GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:57:43.673151 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-7cba221c-dd7a-4815-a9a8-ba472f1b1618 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c345b278e4437d98f9b1f412bbca49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00e3dc3a73a42bdb9426b0213933056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:43.679555 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-7cba221c-dd7a-4815-a9a8-ba472f1b1618 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] 10.222.0.13 "GET /compute/v2.1/servers/31729dc9-9c30-4111-a6a2-2e308abb7b00" status: 200 len: 1314 microversion: 2.1 time: 0.157224 Jun 23 11:57:43.680125 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 614/1239] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:43 2022] GET /compute/v2.1/servers/31729dc9-9c30-4111-a6a2-2e308abb7b00 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:44.618484 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-a72c9eee-e669-4511-ab11-36c5dc241d2d tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:44.621657 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-a72c9eee-e669-4511-ab11-36c5dc241d2d tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] [instance: 06c1d69d-fafe-412e-ac84-49c12c6029d0] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:44.625821 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a72c9eee-e669-4511-ab11-36c5dc241d2d tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:44.626278 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a72c9eee-e669-4511-ab11-36c5dc241d2d tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:44.627070 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a72c9eee-e669-4511-ab11-36c5dc241d2d tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:44.627502 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a72c9eee-e669-4511-ab11-36c5dc241d2d tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:44.659484 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-a72c9eee-e669-4511-ab11-36c5dc241d2d tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] 10.222.0.13 "GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044841 Jun 23 11:57:44.661696 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 626/1240] 10.222.0.13 () {58 vars in 1301 bytes} [Thu Jun 23 11:57:44 2022] GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 11:57:44.671746 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-3212ae89-2b0b-44b4-b3da-b3067100db93 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:44.672219 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-3212ae89-2b0b-44b4-b3da-b3067100db93 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] [instance: 06c1d69d-fafe-412e-ac84-49c12c6029d0] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:44.679282 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-3212ae89-2b0b-44b4-b3da-b3067100db93 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:44.679727 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-3212ae89-2b0b-44b4-b3da-b3067100db93 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:44.680501 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-3212ae89-2b0b-44b4-b3da-b3067100db93 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:44.680941 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-3212ae89-2b0b-44b4-b3da-b3067100db93 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:44.696201 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-21830aa0-8422-4396-b941-fd118e58acdf tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:44.696814 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-21830aa0-8422-4396-b941-fd118e58acdf tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] [instance: 31729dc9-9c30-4111-a6a2-2e308abb7b00] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:44.704124 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-21830aa0-8422-4396-b941-fd118e58acdf tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:44.707632 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-21830aa0-8422-4396-b941-fd118e58acdf tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:44.707632 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-21830aa0-8422-4396-b941-fd118e58acdf tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:44.707632 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-21830aa0-8422-4396-b941-fd118e58acdf tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:44.842770 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-21830aa0-8422-4396-b941-fd118e58acdf tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c345b278e4437d98f9b1f412bbca49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00e3dc3a73a42bdb9426b0213933056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:44.851419 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-21830aa0-8422-4396-b941-fd118e58acdf tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] 10.222.0.13 "GET /compute/v2.1/servers/31729dc9-9c30-4111-a6a2-2e308abb7b00" status: 200 len: 1314 microversion: 2.1 time: 0.159114 Jun 23 11:57:44.852022 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 627/1241] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:44 2022] GET /compute/v2.1/servers/31729dc9-9c30-4111-a6a2-2e308abb7b00 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:45.062010 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.wsgi [None req-3212ae89-2b0b-44b4-b3da-b3067100db93 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] HTTP exception thrown: Instance 06c1d69d-fafe-412e-ac84-49c12c6029d0 is not attached to volume 29ecd8ea-6be5-4ff0-8be1-c2b2e3ebd7c0 Jun 23 11:57:45.064475 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-3212ae89-2b0b-44b4-b3da-b3067100db93 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Request method failure captured: Jun 23 11:57:45.064475 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: request: DELETE /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0/os-volume_attachments/29ecd8ea-6be5-4ff0-8be1-c2b2e3ebd7c0 HTTP/1.1 Jun 23 11:57:45.064475 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Accept: application/json Jun 23 11:57:45.064475 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Accept-Encoding: identity Jun 23 11:57:45.064475 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Connection: close Jun 23 11:57:45.064475 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Content-Length: 0 Jun 23 11:57:45.064475 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Content-Type: application/json Jun 23 11:57:45.064475 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Host: 10.222.0.13 Jun 23 11:57:45.064475 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Openstack-System-Scope: None Jun 23 11:57:45.064475 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: User-Agent: python-urllib3/1.26.9 Jun 23 11:57:45.064475 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Auth-Token: gAAAAABitFRRh-ZpTiGwjm1r4XiOATIwStCk07kf11hdSNX12dtOQzbj6_LanNUdubAG-V3gTPbI6Z2rFcyU8nyQ25AqyCmkVKn7GGD2WYB1dH3lPvKeztmTkDhb9bn-6ufZ5YZO2V9dljTkae8-xTslsPJCQ-z0BFXtCw9JGqJBrrhSLZj4NkM Jun 23 11:57:45.064475 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Domain-Id: None Jun 23 11:57:45.064475 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Domain-Name: None Jun 23 11:57:45.064475 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Identity-Status: Confirmed Jun 23 11:57:45.064475 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Is-Admin-Project: True Jun 23 11:57:45.064475 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Domain-Id: default Jun 23 11:57:45.064475 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Domain-Name: Default Jun 23 11:57:45.064475 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Id: 17a1542e108d4e3e85fe5525a7e331d0 Jun 23 11:57:45.064475 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Name: tempest-TestMinimumBasicScenario-1460101454 Jun 23 11:57:45.064475 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Role: member,reader Jun 23 11:57:45.064475 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Roles: member,reader Jun 23 11:57:45.066483 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_17a1542e108d4e3e85fe5525a7e331d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/17a1542e108d4e3e85fe5525a7e331d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/17a1542e108d4e3e85fe5525a7e331d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/17a1542e108d4e3e85fe5525a7e331d0"}]}] Jun 23 11:57:45.066483 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant: tempest-TestMinimumBasicScenario-1460101454 Jun 23 11:57:45.066483 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant-Id: 17a1542e108d4e3e85fe5525a7e331d0 Jun 23 11:57:45.066483 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1460101454 Jun 23 11:57:45.066483 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User: tempest-TestMinimumBasicScenario-1460101454-project Jun 23 11:57:45.066483 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Domain-Id: default Jun 23 11:57:45.066483 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Domain-Name: Default Jun 23 11:57:45.066483 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Id: 15a4c8e15cd44904805c2519c4b6864a Jun 23 11:57:45.066483 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Name: tempest-TestMinimumBasicScenario-1460101454-project Jun 23 11:57:45.066483 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: method: > Jun 23 11:57:45.066483 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: exception: Instance 06c1d69d-fafe-412e-ac84-49c12c6029d0 is not attached to volume 29ecd8ea-6be5-4ff0-8be1-c2b2e3ebd7c0 Jun 23 11:57:45.067850 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: action_args: {'server_id': '06c1d69d-fafe-412e-ac84-49c12c6029d0', 'id': '29ecd8ea-6be5-4ff0-8be1-c2b2e3ebd7c0'} Jun 23 11:57:45.067850 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:57:45.067850 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:57:45.067850 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 23 11:57:45.067850 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 23 11:57:45.067850 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 23 11:57:45.067850 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 23 11:57:45.067850 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 23 11:57:45.067850 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 23 11:57:45.067850 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 29ecd8ea-6be5-4ff0-8be1-c2b2e3ebd7c0. Jun 23 11:57:45.067850 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:57:45.067850 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:57:45.067850 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:57:45.067850 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:57:45.067850 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:57:45.067850 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:57:45.067850 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:57:45.067850 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:57:45.067850 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:57:45.069651 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:57:45.069651 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 23 11:57:45.069651 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 23 11:57:45.069651 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06c1d69d-fafe-412e-ac84-49c12c6029d0 is not attached to volume 29ecd8ea-6be5-4ff0-8be1-c2b2e3ebd7c0 Jun 23 11:57:45.069651 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:57:45.069651 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:57:45.069651 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:57:45.069651 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:57:45.069651 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:57:45.069651 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:57:45.069651 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:57:45.069651 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:57:45.069651 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06c1d69d-fafe-412e-ac84-49c12c6029d0 is not attached to volume 29ecd8ea-6be5-4ff0-8be1-c2b2e3ebd7c0 Jun 23 11:57:45.069651 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:57:45.069651 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-3212ae89-2b0b-44b4-b3da-b3067100db93 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Returning 404 to user: Instance 06c1d69d-fafe-412e-ac84-49c12c6029d0 is not attached to volume 29ecd8ea-6be5-4ff0-8be1-c2b2e3ebd7c0 {{(pid=124669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:57:45.071351 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-3212ae89-2b0b-44b4-b3da-b3067100db93 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] 10.222.0.13 "DELETE /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0/os-volume_attachments/29ecd8ea-6be5-4ff0-8be1-c2b2e3ebd7c0" status: 404 len: 154 microversion: 2.1 time: 0.399088 Jun 23 11:57:45.071351 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 615/1242] 10.222.0.13 () {58 vars in 1415 bytes} [Thu Jun 23 11:57:44 2022] DELETE /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0/os-volume_attachments/29ecd8ea-6be5-4ff0-8be1-c2b2e3ebd7c0 => generated 154 bytes in 400 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:57:45.868965 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-ce48c1e0-1adb-4857-95d3-2b0fb1b84480 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:45.869471 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-ce48c1e0-1adb-4857-95d3-2b0fb1b84480 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] [instance: 31729dc9-9c30-4111-a6a2-2e308abb7b00] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:45.876011 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-ce48c1e0-1adb-4857-95d3-2b0fb1b84480 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:45.876481 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-ce48c1e0-1adb-4857-95d3-2b0fb1b84480 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:45.889074 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-ce48c1e0-1adb-4857-95d3-2b0fb1b84480 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:45.889074 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-ce48c1e0-1adb-4857-95d3-2b0fb1b84480 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:46.007014 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-ce48c1e0-1adb-4857-95d3-2b0fb1b84480 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c345b278e4437d98f9b1f412bbca49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00e3dc3a73a42bdb9426b0213933056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:46.015691 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-ce48c1e0-1adb-4857-95d3-2b0fb1b84480 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] 10.222.0.13 "GET /compute/v2.1/servers/31729dc9-9c30-4111-a6a2-2e308abb7b00" status: 200 len: 1314 microversion: 2.1 time: 0.151233 Jun 23 11:57:46.016442 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 628/1243] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:45 2022] GET /compute/v2.1/servers/31729dc9-9c30-4111-a6a2-2e308abb7b00 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:46.068986 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [req-58b5a641-0c85-480f-804a-62cdbac1cbc4 req-d82fe60f-646b-452e-a4d1-d31112a22b13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31729dc9-9c30-4111-a6a2-2e308abb7b00", "name": "network-vif-plugged", "status": "completed", "tag": "f1955fb4-9730-4dd6-a52a-558f2df5f64a"}]} {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:57:46.077446 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [req-58b5a641-0c85-480f-804a-62cdbac1cbc4 req-d82fe60f-646b-452e-a4d1-d31112a22b13 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:46.077895 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [req-58b5a641-0c85-480f-804a-62cdbac1cbc4 req-d82fe60f-646b-452e-a4d1-d31112a22b13 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:46.089247 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.compute.server_external_events [req-58b5a641-0c85-480f-804a-62cdbac1cbc4 req-d82fe60f-646b-452e-a4d1-d31112a22b13 service nova] Creating event network-vif-plugged:f1955fb4-9730-4dd6-a52a-558f2df5f64a for instance 31729dc9-9c30-4111-a6a2-2e308abb7b00 on hv-cinder-82099 Jun 23 11:57:46.094178 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [req-58b5a641-0c85-480f-804a-62cdbac1cbc4 req-d82fe60f-646b-452e-a4d1-d31112a22b13 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028886 Jun 23 11:57:46.094785 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 616/1244] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:57:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:57:47.032412 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-5a968a52-99d3-4bce-a764-9dcfa5648412 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:47.033018 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-5a968a52-99d3-4bce-a764-9dcfa5648412 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] [instance: 31729dc9-9c30-4111-a6a2-2e308abb7b00] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:47.039999 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-5a968a52-99d3-4bce-a764-9dcfa5648412 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:47.040650 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-5a968a52-99d3-4bce-a764-9dcfa5648412 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:47.041441 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-5a968a52-99d3-4bce-a764-9dcfa5648412 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:47.041871 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-5a968a52-99d3-4bce-a764-9dcfa5648412 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:47.169097 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-5a968a52-99d3-4bce-a764-9dcfa5648412 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c345b278e4437d98f9b1f412bbca49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00e3dc3a73a42bdb9426b0213933056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:47.176407 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-5a968a52-99d3-4bce-a764-9dcfa5648412 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] 10.222.0.13 "GET /compute/v2.1/servers/31729dc9-9c30-4111-a6a2-2e308abb7b00" status: 200 len: 1314 microversion: 2.1 time: 0.147763 Jun 23 11:57:47.176971 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 629/1245] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:47 2022] GET /compute/v2.1/servers/31729dc9-9c30-4111-a6a2-2e308abb7b00 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:48.194631 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-307d8378-ca06-4725-a7b3-bb9fe168497e tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:48.195335 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-307d8378-ca06-4725-a7b3-bb9fe168497e tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] [instance: 31729dc9-9c30-4111-a6a2-2e308abb7b00] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:48.201445 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-307d8378-ca06-4725-a7b3-bb9fe168497e tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:48.201906 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-307d8378-ca06-4725-a7b3-bb9fe168497e tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:48.202688 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-307d8378-ca06-4725-a7b3-bb9fe168497e tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:48.203127 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-307d8378-ca06-4725-a7b3-bb9fe168497e tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:48.341074 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-307d8378-ca06-4725-a7b3-bb9fe168497e tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c345b278e4437d98f9b1f412bbca49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00e3dc3a73a42bdb9426b0213933056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:48.348554 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-307d8378-ca06-4725-a7b3-bb9fe168497e tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] 10.222.0.13 "GET /compute/v2.1/servers/31729dc9-9c30-4111-a6a2-2e308abb7b00" status: 200 len: 1314 microversion: 2.1 time: 0.158648 Jun 23 11:57:48.349117 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 617/1246] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:48 2022] GET /compute/v2.1/servers/31729dc9-9c30-4111-a6a2-2e308abb7b00 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:49.365385 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-e1e634bd-32c1-43a2-9208-475bd4210fea tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:49.365978 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-e1e634bd-32c1-43a2-9208-475bd4210fea tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] [instance: 31729dc9-9c30-4111-a6a2-2e308abb7b00] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:49.372571 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-e1e634bd-32c1-43a2-9208-475bd4210fea tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:49.373009 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-e1e634bd-32c1-43a2-9208-475bd4210fea tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:49.373755 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-e1e634bd-32c1-43a2-9208-475bd4210fea tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:49.374179 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-e1e634bd-32c1-43a2-9208-475bd4210fea tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:49.504174 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-e1e634bd-32c1-43a2-9208-475bd4210fea tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c345b278e4437d98f9b1f412bbca49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00e3dc3a73a42bdb9426b0213933056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:49.512028 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-e1e634bd-32c1-43a2-9208-475bd4210fea tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] 10.222.0.13 "GET /compute/v2.1/servers/31729dc9-9c30-4111-a6a2-2e308abb7b00" status: 200 len: 1314 microversion: 2.1 time: 0.150433 Jun 23 11:57:49.512534 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 630/1247] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:49 2022] GET /compute/v2.1/servers/31729dc9-9c30-4111-a6a2-2e308abb7b00 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:50.528511 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-000c6a4a-5af4-4210-90fc-7800a3136c79 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:50.529140 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-000c6a4a-5af4-4210-90fc-7800a3136c79 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] [instance: 31729dc9-9c30-4111-a6a2-2e308abb7b00] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:50.535673 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-000c6a4a-5af4-4210-90fc-7800a3136c79 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:50.536119 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-000c6a4a-5af4-4210-90fc-7800a3136c79 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:50.537451 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-000c6a4a-5af4-4210-90fc-7800a3136c79 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:50.537882 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-000c6a4a-5af4-4210-90fc-7800a3136c79 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:50.669261 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-000c6a4a-5af4-4210-90fc-7800a3136c79 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c345b278e4437d98f9b1f412bbca49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00e3dc3a73a42bdb9426b0213933056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:50.676716 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-000c6a4a-5af4-4210-90fc-7800a3136c79 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] 10.222.0.13 "GET /compute/v2.1/servers/31729dc9-9c30-4111-a6a2-2e308abb7b00" status: 200 len: 1314 microversion: 2.1 time: 0.152111 Jun 23 11:57:50.677351 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 618/1248] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:50 2022] GET /compute/v2.1/servers/31729dc9-9c30-4111-a6a2-2e308abb7b00 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:51.694518 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-cceb27f0-1fbb-4673-90bb-a19fa6e475f4 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:51.695243 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-cceb27f0-1fbb-4673-90bb-a19fa6e475f4 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] [instance: 31729dc9-9c30-4111-a6a2-2e308abb7b00] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:51.701871 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-cceb27f0-1fbb-4673-90bb-a19fa6e475f4 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:51.702192 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-cceb27f0-1fbb-4673-90bb-a19fa6e475f4 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:51.702986 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-cceb27f0-1fbb-4673-90bb-a19fa6e475f4 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:51.703419 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-cceb27f0-1fbb-4673-90bb-a19fa6e475f4 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:51.760645 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-fe0f63f3-9cd6-41fc-a470-bb047b1defa5 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:51.764800 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-fe0f63f3-9cd6-41fc-a470-bb047b1defa5 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] [instance: 06c1d69d-fafe-412e-ac84-49c12c6029d0] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:51.768055 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-fe0f63f3-9cd6-41fc-a470-bb047b1defa5 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:51.768511 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-fe0f63f3-9cd6-41fc-a470-bb047b1defa5 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:51.769273 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-fe0f63f3-9cd6-41fc-a470-bb047b1defa5 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:51.769704 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-fe0f63f3-9cd6-41fc-a470-bb047b1defa5 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:51.808699 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-fe0f63f3-9cd6-41fc-a470-bb047b1defa5 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] [instance: 06c1d69d-fafe-412e-ac84-49c12c6029d0] Going to try to terminate instance {{(pid=124669) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 11:57:51.858144 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-cceb27f0-1fbb-4673-90bb-a19fa6e475f4 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c345b278e4437d98f9b1f412bbca49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00e3dc3a73a42bdb9426b0213933056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:51.865971 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-cceb27f0-1fbb-4673-90bb-a19fa6e475f4 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] 10.222.0.13 "GET /compute/v2.1/servers/31729dc9-9c30-4111-a6a2-2e308abb7b00" status: 200 len: 1314 microversion: 2.1 time: 0.175390 Jun 23 11:57:51.869077 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 631/1249] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:51 2022] GET /compute/v2.1/servers/31729dc9-9c30-4111-a6a2-2e308abb7b00 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:52.104287 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-fe0f63f3-9cd6-41fc-a470-bb047b1defa5 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] 10.222.0.13 "DELETE /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0" status: 204 len: 0 microversion: 2.1 time: 0.347562 Jun 23 11:57:52.104902 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 619/1250] 10.222.0.13 () {58 vars in 1238 bytes} [Thu Jun 23 11:57:51 2022] DELETE /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 23 11:57:52.113288 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-b5c1209d-fd64-47ad-9899-1d592544e7f3 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:52.113899 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-b5c1209d-fd64-47ad-9899-1d592544e7f3 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] [instance: 06c1d69d-fafe-412e-ac84-49c12c6029d0] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:52.120012 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-b5c1209d-fd64-47ad-9899-1d592544e7f3 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:52.120462 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-b5c1209d-fd64-47ad-9899-1d592544e7f3 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:52.121225 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-b5c1209d-fd64-47ad-9899-1d592544e7f3 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:52.121663 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-b5c1209d-fd64-47ad-9899-1d592544e7f3 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:52.259171 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-b5c1209d-fd64-47ad-9899-1d592544e7f3 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a4c8e15cd44904805c2519c4b6864a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a1542e108d4e3e85fe5525a7e331d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:52.266711 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-b5c1209d-fd64-47ad-9899-1d592544e7f3 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] 10.222.0.13 "GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0" status: 200 len: 1554 microversion: 2.1 time: 0.157277 Jun 23 11:57:52.267304 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 632/1251] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:52 2022] GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0 => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:52.884807 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-c7754766-560b-4dca-8213-43ec7151c24d tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:52.885518 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-c7754766-560b-4dca-8213-43ec7151c24d tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] [instance: 31729dc9-9c30-4111-a6a2-2e308abb7b00] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:52.892007 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c7754766-560b-4dca-8213-43ec7151c24d tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:52.892426 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c7754766-560b-4dca-8213-43ec7151c24d tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:52.893180 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c7754766-560b-4dca-8213-43ec7151c24d tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:52.893612 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c7754766-560b-4dca-8213-43ec7151c24d tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:53.026394 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-c7754766-560b-4dca-8213-43ec7151c24d tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c345b278e4437d98f9b1f412bbca49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00e3dc3a73a42bdb9426b0213933056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:53.033865 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-c7754766-560b-4dca-8213-43ec7151c24d tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] 10.222.0.13 "GET /compute/v2.1/servers/31729dc9-9c30-4111-a6a2-2e308abb7b00" status: 200 len: 1497 microversion: 2.1 time: 0.153920 Jun 23 11:57:53.034419 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 620/1252] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:52 2022] GET /compute/v2.1/servers/31729dc9-9c30-4111-a6a2-2e308abb7b00 => generated 1497 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:53.284455 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-9113b5d8-a923-44a9-a660-a717458506b9 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:53.285108 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-9113b5d8-a923-44a9-a660-a717458506b9 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] [instance: 06c1d69d-fafe-412e-ac84-49c12c6029d0] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:53.292430 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-9113b5d8-a923-44a9-a660-a717458506b9 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:53.292885 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-9113b5d8-a923-44a9-a660-a717458506b9 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:53.293757 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-9113b5d8-a923-44a9-a660-a717458506b9 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:53.294191 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-9113b5d8-a923-44a9-a660-a717458506b9 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:53.436395 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-9113b5d8-a923-44a9-a660-a717458506b9 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a4c8e15cd44904805c2519c4b6864a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a1542e108d4e3e85fe5525a7e331d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:53.445665 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-9113b5d8-a923-44a9-a660-a717458506b9 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] 10.222.0.13 "GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0" status: 200 len: 1554 microversion: 2.1 time: 0.165327 Jun 23 11:57:53.446323 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 633/1253] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:53 2022] GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0 => generated 1554 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:53.887179 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-533d3323-3e6e-49dc-bc55-f09fef366e68 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:53.887750 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-533d3323-3e6e-49dc-bc55-f09fef366e68 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] [instance: 31729dc9-9c30-4111-a6a2-2e308abb7b00] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:53.895165 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-533d3323-3e6e-49dc-bc55-f09fef366e68 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:53.895625 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-533d3323-3e6e-49dc-bc55-f09fef366e68 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:53.896430 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-533d3323-3e6e-49dc-bc55-f09fef366e68 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:53.896875 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-533d3323-3e6e-49dc-bc55-f09fef366e68 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:53.939015 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-533d3323-3e6e-49dc-bc55-f09fef366e68 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] [instance: 31729dc9-9c30-4111-a6a2-2e308abb7b00] Going to try to terminate instance {{(pid=124669) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 11:57:54.298333 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-533d3323-3e6e-49dc-bc55-f09fef366e68 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] 10.222.0.13 "DELETE /compute/v2.1/servers/31729dc9-9c30-4111-a6a2-2e308abb7b00" status: 204 len: 0 microversion: 2.1 time: 0.412024 Jun 23 11:57:54.298333 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 621/1254] 10.222.0.13 () {58 vars in 1238 bytes} [Thu Jun 23 11:57:53 2022] DELETE /compute/v2.1/servers/31729dc9-9c30-4111-a6a2-2e308abb7b00 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 11:57:54.308600 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-4d6adba8-3586-4063-ad01-d0d08239044d tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:54.315929 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-4d6adba8-3586-4063-ad01-d0d08239044d tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] [instance: 31729dc9-9c30-4111-a6a2-2e308abb7b00] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:54.338618 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_api:SELECT=54 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:54.343916 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-4d6adba8-3586-4063-ad01-d0d08239044d tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:54.344380 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-4d6adba8-3586-4063-ad01-d0d08239044d tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:54.345529 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-4d6adba8-3586-4063-ad01-d0d08239044d tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:54.345966 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-4d6adba8-3586-4063-ad01-d0d08239044d tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:54.467184 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-34ff207e-eba5-4aa2-bf64-2ff20224fde2 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:54.468068 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-34ff207e-eba5-4aa2-bf64-2ff20224fde2 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] [instance: 06c1d69d-fafe-412e-ac84-49c12c6029d0] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:54.479948 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-34ff207e-eba5-4aa2-bf64-2ff20224fde2 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:54.480749 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-34ff207e-eba5-4aa2-bf64-2ff20224fde2 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:54.483988 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-34ff207e-eba5-4aa2-bf64-2ff20224fde2 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:54.484691 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-34ff207e-eba5-4aa2-bf64-2ff20224fde2 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:54.561060 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-4d6adba8-3586-4063-ad01-d0d08239044d tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c345b278e4437d98f9b1f412bbca49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00e3dc3a73a42bdb9426b0213933056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:54.569552 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-4d6adba8-3586-4063-ad01-d0d08239044d tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] 10.222.0.13 "GET /compute/v2.1/servers/31729dc9-9c30-4111-a6a2-2e308abb7b00" status: 200 len: 1503 microversion: 2.1 time: 0.269006 Jun 23 11:57:54.570361 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 634/1255] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:54 2022] GET /compute/v2.1/servers/31729dc9-9c30-4111-a6a2-2e308abb7b00 => generated 1503 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:57:54.647571 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-34ff207e-eba5-4aa2-bf64-2ff20224fde2 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a4c8e15cd44904805c2519c4b6864a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a1542e108d4e3e85fe5525a7e331d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:54.654963 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-34ff207e-eba5-4aa2-bf64-2ff20224fde2 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] 10.222.0.13 "GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0" status: 200 len: 1554 microversion: 2.1 time: 0.192734 Jun 23 11:57:54.655598 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 622/1256] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:54 2022] GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0 => generated 1554 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:54.841718 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [req-dabf352b-506c-42be-83c2-25b6f344c937 req-397b9ba1-ff43-4e1a-ac06-7db1540c9005 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06c1d69d-fafe-412e-ac84-49c12c6029d0", "name": "network-vif-deleted", "tag": "2f36a3ef-b1bd-48d9-8060-f3cbb922568c"}]} {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:57:54.850434 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-dabf352b-506c-42be-83c2-25b6f344c937 req-397b9ba1-ff43-4e1a-ac06-7db1540c9005 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:54.851020 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-dabf352b-506c-42be-83c2-25b6f344c937 req-397b9ba1-ff43-4e1a-ac06-7db1540c9005 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:54.862135 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.compute.server_external_events [req-dabf352b-506c-42be-83c2-25b6f344c937 req-397b9ba1-ff43-4e1a-ac06-7db1540c9005 service nova] Creating event network-vif-deleted:2f36a3ef-b1bd-48d9-8060-f3cbb922568c for instance 06c1d69d-fafe-412e-ac84-49c12c6029d0 on hv-cinder-82099 Jun 23 11:57:54.867259 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [req-dabf352b-506c-42be-83c2-25b6f344c937 req-397b9ba1-ff43-4e1a-ac06-7db1540c9005 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029715 Jun 23 11:57:54.867836 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 635/1257] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:57:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:57:55.586441 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-230ea06c-876b-40e7-b3b9-1da111409f37 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:55.587103 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-230ea06c-876b-40e7-b3b9-1da111409f37 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] [instance: 31729dc9-9c30-4111-a6a2-2e308abb7b00] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:55.589559 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:55.595962 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-230ea06c-876b-40e7-b3b9-1da111409f37 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:55.596754 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-230ea06c-876b-40e7-b3b9-1da111409f37 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:55.597559 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-230ea06c-876b-40e7-b3b9-1da111409f37 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:55.598192 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-230ea06c-876b-40e7-b3b9-1da111409f37 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:55.674083 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-1157e121-55b6-441e-ae60-9a0772fdd403 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:55.674781 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-1157e121-55b6-441e-ae60-9a0772fdd403 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] [instance: 06c1d69d-fafe-412e-ac84-49c12c6029d0] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:55.683181 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1157e121-55b6-441e-ae60-9a0772fdd403 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:55.684072 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1157e121-55b6-441e-ae60-9a0772fdd403 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:55.685404 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1157e121-55b6-441e-ae60-9a0772fdd403 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:55.685521 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1157e121-55b6-441e-ae60-9a0772fdd403 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:55.727040 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1157e121-55b6-441e-ae60-9a0772fdd403 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:55.727495 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-1157e121-55b6-441e-ae60-9a0772fdd403 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:55.727949 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.objects.instance [None req-1157e121-55b6-441e-ae60-9a0772fdd403 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lazy-loading 'fault' on Instance uuid 06c1d69d-fafe-412e-ac84-49c12c6029d0 {{(pid=124670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:57:55.813247 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-230ea06c-876b-40e7-b3b9-1da111409f37 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c345b278e4437d98f9b1f412bbca49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00e3dc3a73a42bdb9426b0213933056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:55.814891 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-1157e121-55b6-441e-ae60-9a0772fdd403 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a4c8e15cd44904805c2519c4b6864a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17a1542e108d4e3e85fe5525a7e331d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:55.821331 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-230ea06c-876b-40e7-b3b9-1da111409f37 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] 10.222.0.13 "GET /compute/v2.1/servers/31729dc9-9c30-4111-a6a2-2e308abb7b00" status: 200 len: 1503 microversion: 2.1 time: 0.239270 Jun 23 11:57:55.827919 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 623/1258] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:55 2022] GET /compute/v2.1/servers/31729dc9-9c30-4111-a6a2-2e308abb7b00 => generated 1503 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:55.834590 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-1157e121-55b6-441e-ae60-9a0772fdd403 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] 10.222.0.13 "GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0" status: 200 len: 1348 microversion: 2.1 time: 0.164704 Jun 23 11:57:55.842923 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 636/1259] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:55 2022] GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0 => generated 1348 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:57:56.850353 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-5bb58a8d-553a-4540-8d35-388035bda248 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:56.851020 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-5bb58a8d-553a-4540-8d35-388035bda248 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] [instance: 31729dc9-9c30-4111-a6a2-2e308abb7b00] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:56.851292 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-cad6b93b-af7c-45ed-9eb3-a7f5bd0f93ed tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:56.852025 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-cad6b93b-af7c-45ed-9eb3-a7f5bd0f93ed tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] [instance: 06c1d69d-fafe-412e-ac84-49c12c6029d0] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:56.857785 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-5bb58a8d-553a-4540-8d35-388035bda248 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:56.858234 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-5bb58a8d-553a-4540-8d35-388035bda248 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:56.859024 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-cad6b93b-af7c-45ed-9eb3-a7f5bd0f93ed tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:56.859162 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-5bb58a8d-553a-4540-8d35-388035bda248 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:56.859458 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-5bb58a8d-553a-4540-8d35-388035bda248 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:56.859566 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-cad6b93b-af7c-45ed-9eb3-a7f5bd0f93ed tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:56.860230 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-cad6b93b-af7c-45ed-9eb3-a7f5bd0f93ed tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:56.860667 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-cad6b93b-af7c-45ed-9eb3-a7f5bd0f93ed tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:56.875300 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.wsgi [None req-cad6b93b-af7c-45ed-9eb3-a7f5bd0f93ed tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] HTTP exception thrown: Instance 06c1d69d-fafe-412e-ac84-49c12c6029d0 could not be found. Jun 23 11:57:56.876978 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-cad6b93b-af7c-45ed-9eb3-a7f5bd0f93ed tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Request method failure captured: Jun 23 11:57:56.876978 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: request: GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0 HTTP/1.1 Jun 23 11:57:56.876978 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Accept: application/json Jun 23 11:57:56.876978 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Accept-Encoding: identity Jun 23 11:57:56.876978 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Connection: close Jun 23 11:57:56.876978 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Content-Length: 0 Jun 23 11:57:56.876978 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Content-Type: application/json Jun 23 11:57:56.876978 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Host: 10.222.0.13 Jun 23 11:57:56.876978 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Openstack-System-Scope: None Jun 23 11:57:56.876978 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: User-Agent: python-urllib3/1.26.9 Jun 23 11:57:56.876978 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Auth-Token: gAAAAABitFRRh-ZpTiGwjm1r4XiOATIwStCk07kf11hdSNX12dtOQzbj6_LanNUdubAG-V3gTPbI6Z2rFcyU8nyQ25AqyCmkVKn7GGD2WYB1dH3lPvKeztmTkDhb9bn-6ufZ5YZO2V9dljTkae8-xTslsPJCQ-z0BFXtCw9JGqJBrrhSLZj4NkM Jun 23 11:57:56.876978 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Domain-Id: None Jun 23 11:57:56.876978 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Domain-Name: None Jun 23 11:57:56.876978 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Identity-Status: Confirmed Jun 23 11:57:56.876978 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Is-Admin-Project: True Jun 23 11:57:56.876978 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Domain-Id: default Jun 23 11:57:56.876978 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Domain-Name: Default Jun 23 11:57:56.876978 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Id: 17a1542e108d4e3e85fe5525a7e331d0 Jun 23 11:57:56.876978 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Project-Name: tempest-TestMinimumBasicScenario-1460101454 Jun 23 11:57:56.876978 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Role: member,reader Jun 23 11:57:56.876978 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Roles: member,reader Jun 23 11:57:56.878631 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_17a1542e108d4e3e85fe5525a7e331d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/17a1542e108d4e3e85fe5525a7e331d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/17a1542e108d4e3e85fe5525a7e331d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/17a1542e108d4e3e85fe5525a7e331d0"}]}] Jun 23 11:57:56.878631 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Tenant: tempest-TestMinimumBasicScenario-1460101454 Jun 23 11:57:56.878631 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Tenant-Id: 17a1542e108d4e3e85fe5525a7e331d0 Jun 23 11:57:56.878631 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1460101454 Jun 23 11:57:56.878631 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User: tempest-TestMinimumBasicScenario-1460101454-project Jun 23 11:57:56.878631 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Domain-Id: default Jun 23 11:57:56.878631 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Domain-Name: Default Jun 23 11:57:56.878631 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Id: 15a4c8e15cd44904805c2519c4b6864a Jun 23 11:57:56.878631 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: X-User-Name: tempest-TestMinimumBasicScenario-1460101454-project Jun 23 11:57:56.878631 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: method: > Jun 23 11:57:56.878631 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: exception: Instance 06c1d69d-fafe-412e-ac84-49c12c6029d0 could not be found. Jun 23 11:57:56.878631 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: action_args: {'id': '06c1d69d-fafe-412e-ac84-49c12c6029d0'} Jun 23 11:57:56.879840 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:57:56.879840 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:57:56.879840 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:57:56.879840 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:57:56.879840 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:57:56.879840 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:57:56.879840 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:57:56.879840 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:57:56.879840 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:57:56.879840 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:57:56.879840 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06c1d69d-fafe-412e-ac84-49c12c6029d0 could not be found. Jun 23 11:57:56.879840 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:57:56.879840 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:57:56.879840 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:57:56.879840 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:57:56.879840 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:57:56.879840 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:57:56.879840 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:57:56.879840 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:57:56.879840 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:57:56.881970 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:57:56.881970 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 11:57:56.881970 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 11:57:56.881970 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:57:56.881970 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:57:56.881970 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:57:56.881970 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:57:56.881970 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06c1d69d-fafe-412e-ac84-49c12c6029d0 could not be found. Jun 23 11:57:56.881970 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:57:56.881970 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:57:56.881970 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:57:56.881970 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:57:56.881970 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:57:56.881970 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:57:56.881970 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:57:56.881970 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:57:56.881970 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06c1d69d-fafe-412e-ac84-49c12c6029d0 could not be found. Jun 23 11:57:56.881970 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: ERROR nova.api.openstack.wsgi Jun 23 11:57:56.883883 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-cad6b93b-af7c-45ed-9eb3-a7f5bd0f93ed tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Returning 404 to user: Instance 06c1d69d-fafe-412e-ac84-49c12c6029d0 could not be found. {{(pid=124670) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:57:56.883883 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-cad6b93b-af7c-45ed-9eb3-a7f5bd0f93ed tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] 10.222.0.13 "GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0" status: 404 len: 111 microversion: 2.1 time: 0.031103 Jun 23 11:57:56.883883 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 637/1260] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:56 2022] GET /compute/v2.1/servers/06c1d69d-fafe-412e-ac84-49c12c6029d0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 23 11:57:56.886634 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [req-2f92c6cc-1a70-4d0d-8253-163d7a352389 req-25f6199e-4c34-457a-a41c-f8b493f99360 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31729dc9-9c30-4111-a6a2-2e308abb7b00", "name": "network-vif-deleted", "tag": "f1955fb4-9730-4dd6-a52a-558f2df5f64a"}]} {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:57:56.894794 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-2f92c6cc-1a70-4d0d-8253-163d7a352389 req-25f6199e-4c34-457a-a41c-f8b493f99360 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:56.895237 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-2f92c6cc-1a70-4d0d-8253-163d7a352389 req-25f6199e-4c34-457a-a41c-f8b493f99360 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:56.897223 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-5bb58a8d-553a-4540-8d35-388035bda248 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:56.897757 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-5bb58a8d-553a-4540-8d35-388035bda248 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:56.898204 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.objects.instance [None req-5bb58a8d-553a-4540-8d35-388035bda248 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lazy-loading 'fault' on Instance uuid 31729dc9-9c30-4111-a6a2-2e308abb7b00 {{(pid=124669) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:57:56.906661 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.compute.server_external_events [req-2f92c6cc-1a70-4d0d-8253-163d7a352389 req-25f6199e-4c34-457a-a41c-f8b493f99360 service nova] Creating event network-vif-deleted:f1955fb4-9730-4dd6-a52a-558f2df5f64a for instance 31729dc9-9c30-4111-a6a2-2e308abb7b00 on hv-cinder-82099 Jun 23 11:57:56.919211 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [req-2f92c6cc-1a70-4d0d-8253-163d7a352389 req-25f6199e-4c34-457a-a41c-f8b493f99360 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035844 Jun 23 11:57:56.919654 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 638/1261] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:57:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:57:56.924779 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-1aa69a46-75a1-418d-915c-48ee8f025d60 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] Calling method '.version_select at 0x7f5d0ae31430>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:56.952737 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-5bb58a8d-553a-4540-8d35-388035bda248 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69c345b278e4437d98f9b1f412bbca49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00e3dc3a73a42bdb9426b0213933056', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:56.960236 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-5bb58a8d-553a-4540-8d35-388035bda248 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] 10.222.0.13 "GET /compute/v2.1/servers/31729dc9-9c30-4111-a6a2-2e308abb7b00" status: 200 len: 1304 microversion: 2.1 time: 0.113698 Jun 23 11:57:56.965609 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 624/1262] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:56 2022] GET /compute/v2.1/servers/31729dc9-9c30-4111-a6a2-2e308abb7b00 => generated 1304 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:57.044462 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-1aa69a46-75a1-418d-915c-48ee8f025d60 tempest-TestMinimumBasicScenario-1460101454 tempest-TestMinimumBasicScenario-1460101454-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-264066732" status: 202 len: 0 microversion: 2.1 time: 0.123602 Jun 23 11:57:57.045166 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 639/1263] 10.222.0.13 () {58 vars in 1268 bytes} [Thu Jun 23 11:57:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-264066732 => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 11:57:57.977319 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-00f3f097-1a9b-47c6-86fa-70e1ef5c6337 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:57.977943 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-00f3f097-1a9b-47c6-86fa-70e1ef5c6337 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] [instance: 31729dc9-9c30-4111-a6a2-2e308abb7b00] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:57.984728 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-00f3f097-1a9b-47c6-86fa-70e1ef5c6337 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:57.985180 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-00f3f097-1a9b-47c6-86fa-70e1ef5c6337 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:57.985941 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-00f3f097-1a9b-47c6-86fa-70e1ef5c6337 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:57.986379 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-00f3f097-1a9b-47c6-86fa-70e1ef5c6337 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:57.999979 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.wsgi [None req-00f3f097-1a9b-47c6-86fa-70e1ef5c6337 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] HTTP exception thrown: Instance 31729dc9-9c30-4111-a6a2-2e308abb7b00 could not be found. Jun 23 11:57:58.001651 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-00f3f097-1a9b-47c6-86fa-70e1ef5c6337 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Request method failure captured: Jun 23 11:57:58.001651 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: request: GET /compute/v2.1/servers/31729dc9-9c30-4111-a6a2-2e308abb7b00 HTTP/1.1 Jun 23 11:57:58.001651 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Accept: application/json Jun 23 11:57:58.001651 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Accept-Encoding: identity Jun 23 11:57:58.001651 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Connection: close Jun 23 11:57:58.001651 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Content-Length: 0 Jun 23 11:57:58.001651 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Content-Type: application/json Jun 23 11:57:58.001651 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Host: 10.222.0.13 Jun 23 11:57:58.001651 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Openstack-System-Scope: None Jun 23 11:57:58.001651 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: User-Agent: python-urllib3/1.26.9 Jun 23 11:57:58.001651 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Auth-Token: gAAAAABitFURMW1qzTWGJno021Hpt-oOF5dBjIhAKQca_a7kkb2Mh37MoCX2gq4MY816m0tkx_PDFTRa8A13JLp3Dwi8QAS4BANmW_iBbN_B7yRORT3FVeBpOccESzMVHnu6AWU-AF-tm_bxfqerOi_sx60YUHfWnT05SGPlJn1fx-3RSQKCM4U Jun 23 11:57:58.001651 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Domain-Id: None Jun 23 11:57:58.001651 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Domain-Name: None Jun 23 11:57:58.001651 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Identity-Status: Confirmed Jun 23 11:57:58.001651 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Is-Admin-Project: True Jun 23 11:57:58.001651 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Domain-Id: default Jun 23 11:57:58.001651 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Domain-Name: Default Jun 23 11:57:58.001651 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Id: a00e3dc3a73a42bdb9426b0213933056 Jun 23 11:57:58.001651 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Name: tempest-VolumesActionsTest-290793612 Jun 23 11:57:58.001651 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Role: member,reader Jun 23 11:57:58.001651 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Roles: member,reader Jun 23 11:57:58.003411 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a00e3dc3a73a42bdb9426b0213933056"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a00e3dc3a73a42bdb9426b0213933056"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a00e3dc3a73a42bdb9426b0213933056"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a00e3dc3a73a42bdb9426b0213933056"}]}] Jun 23 11:57:58.003411 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant: tempest-VolumesActionsTest-290793612 Jun 23 11:57:58.003411 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant-Id: a00e3dc3a73a42bdb9426b0213933056 Jun 23 11:57:58.003411 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant-Name: tempest-VolumesActionsTest-290793612 Jun 23 11:57:58.003411 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User: tempest-VolumesActionsTest-290793612-project Jun 23 11:57:58.003411 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Domain-Id: default Jun 23 11:57:58.003411 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Domain-Name: Default Jun 23 11:57:58.003411 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Id: 69c345b278e4437d98f9b1f412bbca49 Jun 23 11:57:58.003411 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Name: tempest-VolumesActionsTest-290793612-project Jun 23 11:57:58.003411 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: method: > Jun 23 11:57:58.003411 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: exception: Instance 31729dc9-9c30-4111-a6a2-2e308abb7b00 could not be found. Jun 23 11:57:58.003411 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: action_args: {'id': '31729dc9-9c30-4111-a6a2-2e308abb7b00'} Jun 23 11:57:58.004392 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:57:58.004392 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:57:58.004392 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:57:58.004392 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:57:58.004392 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:57:58.004392 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:57:58.004392 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:57:58.004392 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:57:58.004392 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:57:58.004392 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:57:58.004392 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31729dc9-9c30-4111-a6a2-2e308abb7b00 could not be found. Jun 23 11:57:58.004392 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:57:58.004392 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:57:58.004392 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:57:58.004392 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:57:58.004392 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:57:58.004392 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:57:58.004392 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:57:58.004392 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:57:58.004392 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:57:58.006752 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:57:58.006752 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 11:57:58.006752 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 11:57:58.006752 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:57:58.006752 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:57:58.006752 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:57:58.006752 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:57:58.006752 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31729dc9-9c30-4111-a6a2-2e308abb7b00 could not be found. Jun 23 11:57:58.006752 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:57:58.006752 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:57:58.006752 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:57:58.006752 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:57:58.006752 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:57:58.006752 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:57:58.006752 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:57:58.006752 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:57:58.006752 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31729dc9-9c30-4111-a6a2-2e308abb7b00 could not be found. Jun 23 11:57:58.006752 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:57:58.008207 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-00f3f097-1a9b-47c6-86fa-70e1ef5c6337 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] Returning 404 to user: Instance 31729dc9-9c30-4111-a6a2-2e308abb7b00 could not be found. {{(pid=124669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:57:58.008207 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-00f3f097-1a9b-47c6-86fa-70e1ef5c6337 tempest-VolumesActionsTest-290793612 tempest-VolumesActionsTest-290793612-project] 10.222.0.13 "GET /compute/v2.1/servers/31729dc9-9c30-4111-a6a2-2e308abb7b00" status: 404 len: 111 microversion: 2.1 time: 0.029849 Jun 23 11:57:58.008207 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 625/1264] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:57 2022] GET /compute/v2.1/servers/31729dc9-9c30-4111-a6a2-2e308abb7b00 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:59:03.208026 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_cell1:SELECT=81 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:59:03.208755 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_api:SELECT=14,nova_api:DELETE=1 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:59:03.213045 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-2d13b8f4-dccb-4cc0-b961-6af7910fad52 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-335838312", "imageRef": "b19d6f23-214c-4432-bee6-455978023759", "flavorRef": "452"}} {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:59:03.421885 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.network.neutron [None req-2d13b8f4-dccb-4cc0-b961-6af7910fad52 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] validate_networks() for None {{(pid=124670) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 11:59:03.696419 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.virt.hardware [None req-2d13b8f4-dccb-4cc0-b961-6af7910fad52 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Flavor limits 0:0:0 {{(pid=124670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 11:59:03.696419 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.virt.hardware [None req-2d13b8f4-dccb-4cc0-b961-6af7910fad52 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Image limits 0:0:0 {{(pid=124670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 11:59:03.696419 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.virt.hardware [None req-2d13b8f4-dccb-4cc0-b961-6af7910fad52 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Flavor pref 0:0:0 {{(pid=124670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 11:59:03.696419 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.virt.hardware [None req-2d13b8f4-dccb-4cc0-b961-6af7910fad52 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Image pref 0:0:0 {{(pid=124670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 11:59:03.696419 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.virt.hardware [None req-2d13b8f4-dccb-4cc0-b961-6af7910fad52 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124670) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 11:59:03.705293 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-2d13b8f4-dccb-4cc0-b961-6af7910fad52 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:03.705737 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-2d13b8f4-dccb-4cc0-b961-6af7910fad52 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:03.707216 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-2d13b8f4-dccb-4cc0-b961-6af7910fad52 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:03.707651 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-2d13b8f4-dccb-4cc0-b961-6af7910fad52 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:03.724813 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.quota [None req-2d13b8f4-dccb-4cc0-b961-6af7910fad52 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Getting quotas for project f3934169b16f4e589b7670d234a38252. Resources: {'cores', 'instances', 'ram'} {{(pid=124670) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:59:03.729096 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.quota [None req-2d13b8f4-dccb-4cc0-b961-6af7910fad52 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Getting quotas for user 9153568c8f0b4037afabf05f23da3459 and project f3934169b16f4e589b7670d234a38252. Resources: {'cores', 'instances', 'ram'} {{(pid=124670) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:59:03.740675 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-2d13b8f4-dccb-4cc0-b961-6af7910fad52 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Going to run 1 instances... {{(pid=124670) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 11:59:03.743022 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-2d13b8f4-dccb-4cc0-b961-6af7910fad52 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] [instance: 148493dd-a3aa-44da-870f-e83ba9e3cf16] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b19d6f23-214c-4432-bee6-455978023759',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124670) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 11:59:03.884447 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-2d13b8f4-dccb-4cc0-b961-6af7910fad52 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.678473 Jun 23 11:59:03.885088 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 640/1265] 10.222.0.13 () {60 vars in 1146 bytes} [Thu Jun 23 11:59:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 680 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 11:59:03.893142 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_api:SELECT=7 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:59:03.894694 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:59:03.898672 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-7ff37bd2-b36b-499d-9710-470aeaf1d8bf tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:03.899761 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-7ff37bd2-b36b-499d-9710-470aeaf1d8bf tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] [instance: 148493dd-a3aa-44da-870f-e83ba9e3cf16] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:03.953235 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-7ff37bd2-b36b-499d-9710-470aeaf1d8bf tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9153568c8f0b4037afabf05f23da3459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3934169b16f4e589b7670d234a38252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:03.962816 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-7ff37bd2-b36b-499d-9710-470aeaf1d8bf tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] 10.222.0.13 "GET /compute/v2.1/servers/148493dd-a3aa-44da-870f-e83ba9e3cf16" status: 200 len: 1214 microversion: 2.1 time: 0.070880 Jun 23 11:59:03.963393 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 626/1266] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:59:03 2022] GET /compute/v2.1/servers/148493dd-a3aa-44da-870f-e83ba9e3cf16 => generated 1214 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:59:04.981133 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-a54e1a10-8729-45ba-8b95-ba09aee23fe2 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:04.981760 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-a54e1a10-8729-45ba-8b95-ba09aee23fe2 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] [instance: 148493dd-a3aa-44da-870f-e83ba9e3cf16] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:05.036773 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-a54e1a10-8729-45ba-8b95-ba09aee23fe2 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9153568c8f0b4037afabf05f23da3459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3934169b16f4e589b7670d234a38252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:05.043633 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-a54e1a10-8729-45ba-8b95-ba09aee23fe2 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] 10.222.0.13 "GET /compute/v2.1/servers/148493dd-a3aa-44da-870f-e83ba9e3cf16" status: 200 len: 1214 microversion: 2.1 time: 0.066902 Jun 23 11:59:05.044185 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 641/1267] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:59:04 2022] GET /compute/v2.1/servers/148493dd-a3aa-44da-870f-e83ba9e3cf16 => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:59:06.060845 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-c5bdaac4-ff81-44f2-bc03-c6d1f3d5df53 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:06.061441 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-c5bdaac4-ff81-44f2-bc03-c6d1f3d5df53 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] [instance: 148493dd-a3aa-44da-870f-e83ba9e3cf16] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:06.068899 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c5bdaac4-ff81-44f2-bc03-c6d1f3d5df53 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:06.069338 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c5bdaac4-ff81-44f2-bc03-c6d1f3d5df53 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:06.070101 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c5bdaac4-ff81-44f2-bc03-c6d1f3d5df53 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:06.070556 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-c5bdaac4-ff81-44f2-bc03-c6d1f3d5df53 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:06.245850 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-c5bdaac4-ff81-44f2-bc03-c6d1f3d5df53 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9153568c8f0b4037afabf05f23da3459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3934169b16f4e589b7670d234a38252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:06.253273 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-c5bdaac4-ff81-44f2-bc03-c6d1f3d5df53 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] 10.222.0.13 "GET /compute/v2.1/servers/148493dd-a3aa-44da-870f-e83ba9e3cf16" status: 200 len: 1274 microversion: 2.1 time: 0.196744 Jun 23 11:59:06.253836 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 627/1268] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:59:06 2022] GET /compute/v2.1/servers/148493dd-a3aa-44da-870f-e83ba9e3cf16 => generated 1274 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:59:07.270111 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-d00419ed-fd6e-46d1-9f7c-c890c345c299 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:07.271569 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-d00419ed-fd6e-46d1-9f7c-c890c345c299 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] [instance: 148493dd-a3aa-44da-870f-e83ba9e3cf16] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:07.279744 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-d00419ed-fd6e-46d1-9f7c-c890c345c299 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:07.280319 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-d00419ed-fd6e-46d1-9f7c-c890c345c299 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:07.281136 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-d00419ed-fd6e-46d1-9f7c-c890c345c299 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:07.281578 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-d00419ed-fd6e-46d1-9f7c-c890c345c299 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:07.412042 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-d00419ed-fd6e-46d1-9f7c-c890c345c299 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9153568c8f0b4037afabf05f23da3459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3934169b16f4e589b7670d234a38252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:07.419877 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-d00419ed-fd6e-46d1-9f7c-c890c345c299 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] 10.222.0.13 "GET /compute/v2.1/servers/148493dd-a3aa-44da-870f-e83ba9e3cf16" status: 200 len: 1314 microversion: 2.1 time: 0.153703 Jun 23 11:59:07.420543 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 642/1269] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:59:07 2022] GET /compute/v2.1/servers/148493dd-a3aa-44da-870f-e83ba9e3cf16 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:59:08.032757 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [req-b7d1d949-86b0-4788-af30-d1a59453de38 req-b8431017-0fd9-4099-8eb3-66aae3d8542f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "148493dd-a3aa-44da-870f-e83ba9e3cf16", "tag": "2229cf1f-08b5-4b42-ab8b-89c7c82a7d81"}]} {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:59:08.048868 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [req-b7d1d949-86b0-4788-af30-d1a59453de38 req-b8431017-0fd9-4099-8eb3-66aae3d8542f service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:08.048868 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [req-b7d1d949-86b0-4788-af30-d1a59453de38 req-b8431017-0fd9-4099-8eb3-66aae3d8542f service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:08.057491 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.compute.server_external_events [req-b7d1d949-86b0-4788-af30-d1a59453de38 req-b8431017-0fd9-4099-8eb3-66aae3d8542f service nova] Creating event network-changed:2229cf1f-08b5-4b42-ab8b-89c7c82a7d81 for instance 148493dd-a3aa-44da-870f-e83ba9e3cf16 on hv-cinder-82099 Jun 23 11:59:08.062781 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [req-b7d1d949-86b0-4788-af30-d1a59453de38 req-b8431017-0fd9-4099-8eb3-66aae3d8542f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034735 Jun 23 11:59:08.063386 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 628/1270] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:59:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:59:08.437162 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-33a0f130-0fff-4efa-a657-3fa8067c1427 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:08.437763 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-33a0f130-0fff-4efa-a657-3fa8067c1427 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] [instance: 148493dd-a3aa-44da-870f-e83ba9e3cf16] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:08.444481 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-33a0f130-0fff-4efa-a657-3fa8067c1427 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:08.444950 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-33a0f130-0fff-4efa-a657-3fa8067c1427 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:08.445714 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-33a0f130-0fff-4efa-a657-3fa8067c1427 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:08.446140 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-33a0f130-0fff-4efa-a657-3fa8067c1427 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:08.587041 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-33a0f130-0fff-4efa-a657-3fa8067c1427 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9153568c8f0b4037afabf05f23da3459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3934169b16f4e589b7670d234a38252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:08.596118 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-33a0f130-0fff-4efa-a657-3fa8067c1427 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] 10.222.0.13 "GET /compute/v2.1/servers/148493dd-a3aa-44da-870f-e83ba9e3cf16" status: 200 len: 1314 microversion: 2.1 time: 0.162599 Jun 23 11:59:08.596783 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 643/1271] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:59:08 2022] GET /compute/v2.1/servers/148493dd-a3aa-44da-870f-e83ba9e3cf16 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:59:09.618192 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-246687f2-2342-4f3a-a703-e1e731fd919c tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:09.621197 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-246687f2-2342-4f3a-a703-e1e731fd919c tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] [instance: 148493dd-a3aa-44da-870f-e83ba9e3cf16] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:09.625564 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-246687f2-2342-4f3a-a703-e1e731fd919c tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:09.626011 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-246687f2-2342-4f3a-a703-e1e731fd919c tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:09.626796 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-246687f2-2342-4f3a-a703-e1e731fd919c tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:09.627231 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-246687f2-2342-4f3a-a703-e1e731fd919c tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:09.763597 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-246687f2-2342-4f3a-a703-e1e731fd919c tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9153568c8f0b4037afabf05f23da3459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3934169b16f4e589b7670d234a38252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:09.771402 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-246687f2-2342-4f3a-a703-e1e731fd919c tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] 10.222.0.13 "GET /compute/v2.1/servers/148493dd-a3aa-44da-870f-e83ba9e3cf16" status: 200 len: 1314 microversion: 2.1 time: 0.160192 Jun 23 11:59:09.771968 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 629/1272] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:59:09 2022] GET /compute/v2.1/servers/148493dd-a3aa-44da-870f-e83ba9e3cf16 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:59:10.788761 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-8674a5b2-fedb-4c83-93d9-0ad72d1620e4 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:10.789327 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-8674a5b2-fedb-4c83-93d9-0ad72d1620e4 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] [instance: 148493dd-a3aa-44da-870f-e83ba9e3cf16] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:10.795807 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-8674a5b2-fedb-4c83-93d9-0ad72d1620e4 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:10.796260 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-8674a5b2-fedb-4c83-93d9-0ad72d1620e4 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:10.797022 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-8674a5b2-fedb-4c83-93d9-0ad72d1620e4 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:10.797461 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-8674a5b2-fedb-4c83-93d9-0ad72d1620e4 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:10.925142 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-8674a5b2-fedb-4c83-93d9-0ad72d1620e4 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9153568c8f0b4037afabf05f23da3459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3934169b16f4e589b7670d234a38252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:10.932542 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-8674a5b2-fedb-4c83-93d9-0ad72d1620e4 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] 10.222.0.13 "GET /compute/v2.1/servers/148493dd-a3aa-44da-870f-e83ba9e3cf16" status: 200 len: 1314 microversion: 2.1 time: 0.148369 Jun 23 11:59:10.933102 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 644/1273] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:59:10 2022] GET /compute/v2.1/servers/148493dd-a3aa-44da-870f-e83ba9e3cf16 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:59:11.949690 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-218462df-3eed-466d-a3ec-412fee3a3b2b tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:11.950292 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-218462df-3eed-466d-a3ec-412fee3a3b2b tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] [instance: 148493dd-a3aa-44da-870f-e83ba9e3cf16] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:11.956762 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-218462df-3eed-466d-a3ec-412fee3a3b2b tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:11.957206 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-218462df-3eed-466d-a3ec-412fee3a3b2b tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:11.957953 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-218462df-3eed-466d-a3ec-412fee3a3b2b tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:11.958386 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-218462df-3eed-466d-a3ec-412fee3a3b2b tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:12.348152 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-218462df-3eed-466d-a3ec-412fee3a3b2b tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9153568c8f0b4037afabf05f23da3459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3934169b16f4e589b7670d234a38252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:12.355559 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-218462df-3eed-466d-a3ec-412fee3a3b2b tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] 10.222.0.13 "GET /compute/v2.1/servers/148493dd-a3aa-44da-870f-e83ba9e3cf16" status: 200 len: 1314 microversion: 2.1 time: 0.409740 Jun 23 11:59:12.356128 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 630/1274] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:59:11 2022] GET /compute/v2.1/servers/148493dd-a3aa-44da-870f-e83ba9e3cf16 => generated 1314 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:59:13.372435 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-c79c780b-0330-48e9-9675-29b22d51a829 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:13.373161 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-c79c780b-0330-48e9-9675-29b22d51a829 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] [instance: 148493dd-a3aa-44da-870f-e83ba9e3cf16] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:13.379767 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-c79c780b-0330-48e9-9675-29b22d51a829 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:13.380214 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-c79c780b-0330-48e9-9675-29b22d51a829 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:13.380986 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-c79c780b-0330-48e9-9675-29b22d51a829 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:13.381407 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-c79c780b-0330-48e9-9675-29b22d51a829 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:13.516369 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-c79c780b-0330-48e9-9675-29b22d51a829 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9153568c8f0b4037afabf05f23da3459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3934169b16f4e589b7670d234a38252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:13.524723 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-c79c780b-0330-48e9-9675-29b22d51a829 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] 10.222.0.13 "GET /compute/v2.1/servers/148493dd-a3aa-44da-870f-e83ba9e3cf16" status: 200 len: 1314 microversion: 2.1 time: 0.156178 Jun 23 11:59:13.525282 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 645/1275] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:59:13 2022] GET /compute/v2.1/servers/148493dd-a3aa-44da-870f-e83ba9e3cf16 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:59:14.541887 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-6a07ae96-bc20-4408-9092-8fccad1b9421 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:14.542490 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-6a07ae96-bc20-4408-9092-8fccad1b9421 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] [instance: 148493dd-a3aa-44da-870f-e83ba9e3cf16] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:14.545060 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG dbcounter [-] [124669] Writing DB stats nova_cell0:SELECT=2 {{(pid=124669) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:59:14.549826 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-6a07ae96-bc20-4408-9092-8fccad1b9421 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:14.550274 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-6a07ae96-bc20-4408-9092-8fccad1b9421 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:14.551061 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-6a07ae96-bc20-4408-9092-8fccad1b9421 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:14.551497 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-6a07ae96-bc20-4408-9092-8fccad1b9421 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:14.683319 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-6a07ae96-bc20-4408-9092-8fccad1b9421 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9153568c8f0b4037afabf05f23da3459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3934169b16f4e589b7670d234a38252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:14.690740 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-6a07ae96-bc20-4408-9092-8fccad1b9421 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] 10.222.0.13 "GET /compute/v2.1/servers/148493dd-a3aa-44da-870f-e83ba9e3cf16" status: 200 len: 1314 microversion: 2.1 time: 0.153435 Jun 23 11:59:14.691304 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 631/1276] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:59:14 2022] GET /compute/v2.1/servers/148493dd-a3aa-44da-870f-e83ba9e3cf16 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:59:15.492323 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_cell0:SELECT=2 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:59:15.493973 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG dbcounter [-] [124670] Writing DB stats nova_cell0:SELECT=8 {{(pid=124670) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:59:15.497991 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [req-da63bc3b-d256-49de-bed3-999ca07651fa req-b79bf4dd-d70c-46f3-8a3f-210446f5d103 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "148493dd-a3aa-44da-870f-e83ba9e3cf16", "name": "network-vif-plugged", "status": "completed", "tag": "2229cf1f-08b5-4b42-ab8b-89c7c82a7d81"}]} {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:59:15.506087 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-da63bc3b-d256-49de-bed3-999ca07651fa req-b79bf4dd-d70c-46f3-8a3f-210446f5d103 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:15.506607 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [req-da63bc3b-d256-49de-bed3-999ca07651fa req-b79bf4dd-d70c-46f3-8a3f-210446f5d103 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:15.518175 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.compute.server_external_events [req-da63bc3b-d256-49de-bed3-999ca07651fa req-b79bf4dd-d70c-46f3-8a3f-210446f5d103 service nova] Creating event network-vif-plugged:2229cf1f-08b5-4b42-ab8b-89c7c82a7d81 for instance 148493dd-a3aa-44da-870f-e83ba9e3cf16 on hv-cinder-82099 Jun 23 11:59:15.523540 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [req-da63bc3b-d256-49de-bed3-999ca07651fa req-b79bf4dd-d70c-46f3-8a3f-210446f5d103 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032753 Jun 23 11:59:15.524116 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 646/1277] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:59:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:59:15.707568 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-d4d85d0e-6577-48b0-8f5c-6f5208a39c2e tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:15.708215 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-d4d85d0e-6577-48b0-8f5c-6f5208a39c2e tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] [instance: 148493dd-a3aa-44da-870f-e83ba9e3cf16] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:15.715354 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-d4d85d0e-6577-48b0-8f5c-6f5208a39c2e tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:15.715795 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-d4d85d0e-6577-48b0-8f5c-6f5208a39c2e tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:15.716569 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-d4d85d0e-6577-48b0-8f5c-6f5208a39c2e tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:15.716996 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-d4d85d0e-6577-48b0-8f5c-6f5208a39c2e tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:15.858593 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-d4d85d0e-6577-48b0-8f5c-6f5208a39c2e tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9153568c8f0b4037afabf05f23da3459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3934169b16f4e589b7670d234a38252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:15.859688 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-d4d85d0e-6577-48b0-8f5c-6f5208a39c2e tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] 10.222.0.13 "GET /compute/v2.1/servers/148493dd-a3aa-44da-870f-e83ba9e3cf16" status: 200 len: 1314 microversion: 2.1 time: 0.156060 Jun 23 11:59:15.860257 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 632/1278] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:59:15 2022] GET /compute/v2.1/servers/148493dd-a3aa-44da-870f-e83ba9e3cf16 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:59:16.878139 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-a85b9428-f688-4373-8188-22ca567b9b4b tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:16.878855 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-a85b9428-f688-4373-8188-22ca567b9b4b tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] [instance: 148493dd-a3aa-44da-870f-e83ba9e3cf16] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:16.886867 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a85b9428-f688-4373-8188-22ca567b9b4b tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:16.887321 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a85b9428-f688-4373-8188-22ca567b9b4b tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:16.888081 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a85b9428-f688-4373-8188-22ca567b9b4b tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:16.888516 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-a85b9428-f688-4373-8188-22ca567b9b4b tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:17.021795 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-a85b9428-f688-4373-8188-22ca567b9b4b tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9153568c8f0b4037afabf05f23da3459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3934169b16f4e589b7670d234a38252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:17.029501 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-a85b9428-f688-4373-8188-22ca567b9b4b tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] 10.222.0.13 "GET /compute/v2.1/servers/148493dd-a3aa-44da-870f-e83ba9e3cf16" status: 200 len: 1314 microversion: 2.1 time: 0.156600 Jun 23 11:59:17.030067 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 647/1279] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:59:16 2022] GET /compute/v2.1/servers/148493dd-a3aa-44da-870f-e83ba9e3cf16 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:59:18.045849 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-91019545-0b92-47b4-8cbc-0dcc65181724 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:18.046461 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-91019545-0b92-47b4-8cbc-0dcc65181724 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] [instance: 148493dd-a3aa-44da-870f-e83ba9e3cf16] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:18.052904 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-91019545-0b92-47b4-8cbc-0dcc65181724 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:18.053357 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-91019545-0b92-47b4-8cbc-0dcc65181724 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:18.054446 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-91019545-0b92-47b4-8cbc-0dcc65181724 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:18.054907 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-91019545-0b92-47b4-8cbc-0dcc65181724 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:18.183915 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-91019545-0b92-47b4-8cbc-0dcc65181724 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9153568c8f0b4037afabf05f23da3459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3934169b16f4e589b7670d234a38252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:18.191325 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-91019545-0b92-47b4-8cbc-0dcc65181724 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] 10.222.0.13 "GET /compute/v2.1/servers/148493dd-a3aa-44da-870f-e83ba9e3cf16" status: 200 len: 1464 microversion: 2.1 time: 0.149332 Jun 23 11:59:18.191888 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 633/1280] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:59:18 2022] GET /compute/v2.1/servers/148493dd-a3aa-44da-870f-e83ba9e3cf16 => generated 1464 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:59:18.230799 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-21d448a9-8af9-49e2-8c3f-9c68ce8afc9c tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:18.231323 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-21d448a9-8af9-49e2-8c3f-9c68ce8afc9c tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] [instance: 148493dd-a3aa-44da-870f-e83ba9e3cf16] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:18.238045 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-21d448a9-8af9-49e2-8c3f-9c68ce8afc9c tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:18.238638 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-21d448a9-8af9-49e2-8c3f-9c68ce8afc9c tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:18.239401 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-21d448a9-8af9-49e2-8c3f-9c68ce8afc9c tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:18.239839 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-21d448a9-8af9-49e2-8c3f-9c68ce8afc9c tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:18.265426 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-21d448a9-8af9-49e2-8c3f-9c68ce8afc9c tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] [instance: 148493dd-a3aa-44da-870f-e83ba9e3cf16] Going to try to terminate instance {{(pid=124670) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 11:59:18.503213 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-21d448a9-8af9-49e2-8c3f-9c68ce8afc9c tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] 10.222.0.13 "DELETE /compute/v2.1/servers/148493dd-a3aa-44da-870f-e83ba9e3cf16" status: 204 len: 0 microversion: 2.1 time: 0.275981 Jun 23 11:59:18.503801 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 648/1281] 10.222.0.13 () {58 vars in 1238 bytes} [Thu Jun 23 11:59:18 2022] DELETE /compute/v2.1/servers/148493dd-a3aa-44da-870f-e83ba9e3cf16 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 11:59:18.512466 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-00e79ede-1e22-40d8-af69-f2b41bea2dad tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:18.517470 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-00e79ede-1e22-40d8-af69-f2b41bea2dad tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] [instance: 148493dd-a3aa-44da-870f-e83ba9e3cf16] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:18.519303 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-00e79ede-1e22-40d8-af69-f2b41bea2dad tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:18.519745 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-00e79ede-1e22-40d8-af69-f2b41bea2dad tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:18.520493 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-00e79ede-1e22-40d8-af69-f2b41bea2dad tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:18.520924 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-00e79ede-1e22-40d8-af69-f2b41bea2dad tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:18.652904 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.policy [None req-00e79ede-1e22-40d8-af69-f2b41bea2dad tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9153568c8f0b4037afabf05f23da3459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3934169b16f4e589b7670d234a38252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124669) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:18.660400 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-00e79ede-1e22-40d8-af69-f2b41bea2dad tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] 10.222.0.13 "GET /compute/v2.1/servers/148493dd-a3aa-44da-870f-e83ba9e3cf16" status: 200 len: 1470 microversion: 2.1 time: 0.151868 Jun 23 11:59:18.660963 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 634/1282] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:59:18 2022] GET /compute/v2.1/servers/148493dd-a3aa-44da-870f-e83ba9e3cf16 => generated 1470 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:59:19.677772 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-9de6f4d9-9577-422a-bc24-1cb10e5919c8 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:19.678466 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-9de6f4d9-9577-422a-bc24-1cb10e5919c8 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] [instance: 148493dd-a3aa-44da-870f-e83ba9e3cf16] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:19.686167 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-9de6f4d9-9577-422a-bc24-1cb10e5919c8 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:19.686639 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-9de6f4d9-9577-422a-bc24-1cb10e5919c8 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:19.687398 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-9de6f4d9-9577-422a-bc24-1cb10e5919c8 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:19.687827 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-9de6f4d9-9577-422a-bc24-1cb10e5919c8 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:19.822957 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-9de6f4d9-9577-422a-bc24-1cb10e5919c8 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9153568c8f0b4037afabf05f23da3459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3934169b16f4e589b7670d234a38252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:19.830486 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-9de6f4d9-9577-422a-bc24-1cb10e5919c8 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] 10.222.0.13 "GET /compute/v2.1/servers/148493dd-a3aa-44da-870f-e83ba9e3cf16" status: 200 len: 1470 microversion: 2.1 time: 0.156966 Jun 23 11:59:19.831193 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 649/1283] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:59:19 2022] GET /compute/v2.1/servers/148493dd-a3aa-44da-870f-e83ba9e3cf16 => generated 1470 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:59:20.530814 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [req-246710d2-2b53-4a13-8af8-674ea47835fb req-25770744-f93b-47e0-a656-1aff16edd893 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "148493dd-a3aa-44da-870f-e83ba9e3cf16", "name": "network-vif-deleted", "tag": "2229cf1f-08b5-4b42-ab8b-89c7c82a7d81"}]} {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:59:20.541665 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [req-246710d2-2b53-4a13-8af8-674ea47835fb req-25770744-f93b-47e0-a656-1aff16edd893 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:20.544514 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [req-246710d2-2b53-4a13-8af8-674ea47835fb req-25770744-f93b-47e0-a656-1aff16edd893 service nova] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:20.555215 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.compute.server_external_events [req-246710d2-2b53-4a13-8af8-674ea47835fb req-25770744-f93b-47e0-a656-1aff16edd893 service nova] Creating event network-vif-deleted:2229cf1f-08b5-4b42-ab8b-89c7c82a7d81 for instance 148493dd-a3aa-44da-870f-e83ba9e3cf16 on hv-cinder-82099 Jun 23 11:59:20.560595 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [req-246710d2-2b53-4a13-8af8-674ea47835fb req-25770744-f93b-47e0-a656-1aff16edd893 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033638 Jun 23 11:59:20.561406 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 635/1284] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Jun 23 11:59:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:59:20.848025 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.api.openstack.wsgi [None req-88c90cab-b3fb-49f0-af2d-3d3985ab7299 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Calling method '>' {{(pid=124670) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:20.848633 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.compute.api [None req-88c90cab-b3fb-49f0-af2d-3d3985ab7299 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] [instance: 148493dd-a3aa-44da-870f-e83ba9e3cf16] Fetching instance by UUID {{(pid=124670) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:20.855814 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-88c90cab-b3fb-49f0-af2d-3d3985ab7299 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:20.856263 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-88c90cab-b3fb-49f0-af2d-3d3985ab7299 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:20.857026 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-88c90cab-b3fb-49f0-af2d-3d3985ab7299 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:20.857463 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-88c90cab-b3fb-49f0-af2d-3d3985ab7299 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:20.888476 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-88c90cab-b3fb-49f0-af2d-3d3985ab7299 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:20.888925 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG oslo_concurrency.lockutils [None req-88c90cab-b3fb-49f0-af2d-3d3985ab7299 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124670) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:20.889372 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.objects.instance [None req-88c90cab-b3fb-49f0-af2d-3d3985ab7299 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Lazy-loading 'fault' on Instance uuid 148493dd-a3aa-44da-870f-e83ba9e3cf16 {{(pid=124670) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:59:20.930440 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: DEBUG nova.policy [None req-88c90cab-b3fb-49f0-af2d-3d3985ab7299 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9153568c8f0b4037afabf05f23da3459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3934169b16f4e589b7670d234a38252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124670) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:20.937895 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO nova.api.openstack.requestlog [None req-88c90cab-b3fb-49f0-af2d-3d3985ab7299 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] 10.222.0.13 "GET /compute/v2.1/servers/148493dd-a3aa-44da-870f-e83ba9e3cf16" status: 200 len: 1304 microversion: 2.1 time: 0.093757 Jun 23 11:59:20.938456 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: [pid: 124670|app: 0|req: 650/1285] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:59:20 2022] GET /compute/v2.1/servers/148493dd-a3aa-44da-870f-e83ba9e3cf16 => generated 1304 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:59:21.955652 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-9394cb69-4fbe-4653-b0c2-6d35445c7158 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Calling method '>' {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:21.956367 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.compute.api [None req-9394cb69-4fbe-4653-b0c2-6d35445c7158 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] [instance: 148493dd-a3aa-44da-870f-e83ba9e3cf16] Fetching instance by UUID {{(pid=124669) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:21.963984 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-9394cb69-4fbe-4653-b0c2-6d35445c7158 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:21.964434 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-9394cb69-4fbe-4653-b0c2-6d35445c7158 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:21.965245 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-9394cb69-4fbe-4653-b0c2-6d35445c7158 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:21.965680 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG oslo_concurrency.lockutils [None req-9394cb69-4fbe-4653-b0c2-6d35445c7158 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Lock "10257dc1-1bb0-429b-a4e0-3986d13353db" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124669) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:21.982074 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.wsgi [None req-9394cb69-4fbe-4653-b0c2-6d35445c7158 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] HTTP exception thrown: Instance 148493dd-a3aa-44da-870f-e83ba9e3cf16 could not be found. Jun 23 11:59:21.983764 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-9394cb69-4fbe-4653-b0c2-6d35445c7158 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Request method failure captured: Jun 23 11:59:21.983764 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: request: GET /compute/v2.1/servers/148493dd-a3aa-44da-870f-e83ba9e3cf16 HTTP/1.1 Jun 23 11:59:21.983764 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Accept: application/json Jun 23 11:59:21.983764 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Accept-Encoding: identity Jun 23 11:59:21.983764 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Connection: close Jun 23 11:59:21.983764 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Content-Length: 0 Jun 23 11:59:21.983764 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Content-Type: application/json Jun 23 11:59:21.983764 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Host: 10.222.0.13 Jun 23 11:59:21.983764 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Openstack-System-Scope: None Jun 23 11:59:21.983764 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: User-Agent: python-urllib3/1.26.9 Jun 23 11:59:21.983764 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Auth-Token: gAAAAABitFWFYl-I5yFMNsxxmfeXbieg7cL1DSvvHPB7xlWSkI9QU5R6LB88k0UZTbVUMNFe7jm8wbiy98HJWW0CkjOfrJXEIrDwzuyjCYd-yj_e3QolJB0hOPclkzXPh6BXS604hO5wnMfUpnSUhrY-OlWoqS_yM_P1L_JzlllhSCGikploDnM Jun 23 11:59:21.983764 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Domain-Id: None Jun 23 11:59:21.983764 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Domain-Name: None Jun 23 11:59:21.983764 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Identity-Status: Confirmed Jun 23 11:59:21.983764 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Is-Admin-Project: True Jun 23 11:59:21.983764 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Domain-Id: default Jun 23 11:59:21.983764 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Domain-Name: Default Jun 23 11:59:21.983764 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Id: f3934169b16f4e589b7670d234a38252 Jun 23 11:59:21.983764 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Project-Name: tempest-VolumesNegativeTest-1093385798 Jun 23 11:59:21.983764 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Role: member,reader Jun 23 11:59:21.983764 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Roles: member,reader Jun 23 11:59:21.986100 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_f3934169b16f4e589b7670d234a38252"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f3934169b16f4e589b7670d234a38252"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/f3934169b16f4e589b7670d234a38252"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/f3934169b16f4e589b7670d234a38252"}]}] Jun 23 11:59:21.986100 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant: tempest-VolumesNegativeTest-1093385798 Jun 23 11:59:21.986100 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant-Id: f3934169b16f4e589b7670d234a38252 Jun 23 11:59:21.986100 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-Tenant-Name: tempest-VolumesNegativeTest-1093385798 Jun 23 11:59:21.986100 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User: tempest-VolumesNegativeTest-1093385798-project Jun 23 11:59:21.986100 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Domain-Id: default Jun 23 11:59:21.986100 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Domain-Name: Default Jun 23 11:59:21.986100 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Id: 9153568c8f0b4037afabf05f23da3459 Jun 23 11:59:21.986100 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: X-User-Name: tempest-VolumesNegativeTest-1093385798-project Jun 23 11:59:21.986100 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: method: > Jun 23 11:59:21.986100 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: exception: Instance 148493dd-a3aa-44da-870f-e83ba9e3cf16 could not be found. Jun 23 11:59:21.986100 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: action_args: {'id': '148493dd-a3aa-44da-870f-e83ba9e3cf16'} Jun 23 11:59:21.987186 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: {{(pid=124669) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:59:21.987186 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:59:21.987186 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:59:21.987186 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:59:21.987186 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:59:21.987186 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:59:21.987186 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:59:21.987186 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:59:21.987186 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:59:21.987186 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:59:21.987186 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 148493dd-a3aa-44da-870f-e83ba9e3cf16 could not be found. Jun 23 11:59:21.987186 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:59:21.987186 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:59:21.987186 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:59:21.987186 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:59:21.987186 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:59:21.987186 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:59:21.987186 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:59:21.987186 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:59:21.987186 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:59:21.989101 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:59:21.989101 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 11:59:21.989101 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 11:59:21.989101 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:59:21.989101 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:59:21.989101 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:59:21.989101 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:59:21.989101 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 148493dd-a3aa-44da-870f-e83ba9e3cf16 could not be found. Jun 23 11:59:21.989101 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:59:21.989101 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:59:21.989101 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:59:21.989101 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:59:21.989101 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:59:21.989101 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:59:21.989101 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:59:21.989101 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:59:21.989101 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 148493dd-a3aa-44da-870f-e83ba9e3cf16 could not be found. Jun 23 11:59:21.989101 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: ERROR nova.api.openstack.wsgi Jun 23 11:59:21.990685 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: DEBUG nova.api.openstack.wsgi [None req-9394cb69-4fbe-4653-b0c2-6d35445c7158 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] Returning 404 to user: Instance 148493dd-a3aa-44da-870f-e83ba9e3cf16 could not be found. {{(pid=124669) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:59:21.990685 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO nova.api.openstack.requestlog [None req-9394cb69-4fbe-4653-b0c2-6d35445c7158 tempest-VolumesNegativeTest-1093385798 tempest-VolumesNegativeTest-1093385798-project] 10.222.0.13 "GET /compute/v2.1/servers/148493dd-a3aa-44da-870f-e83ba9e3cf16" status: 404 len: 111 microversion: 2.1 time: 0.034208 Jun 23 11:59:21.990685 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: [pid: 124669|app: 0|req: 636/1286] 10.222.0.13 () {58 vars in 1235 bytes} [Thu Jun 23 11:59:21 2022] GET /compute/v2.1/servers/148493dd-a3aa-44da-870f-e83ba9e3cf16 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 23 12:00:50.864690 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 12:00:50.865240 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Thu Jun 23 12:00:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 12:02:41.794976 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 12:02:41.795517 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Thu Jun 23 12:02:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 12:02:51.828736 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 12:02:51.829385 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Thu Jun 23 12:02:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 12:04:10.872826 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 12:04:10.873421 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Thu Jun 23 12:04:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 12:04:18.996031 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 12:04:18.996770 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Thu Jun 23 12:04:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 12:04:38.023766 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 12:04:38.024403 dv-cinder-820994-2-iscsi devstack@n-api.service[124670]: Thu Jun 23 12:04:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 12:04:39.623975 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 12:04:39.624483 dv-cinder-820994-2-iscsi devstack@n-api.service[124669]: Thu Jun 23 12:04:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!